Effect of Burnout on Post-traumatic Stress Disorder Symptoms Among Firefighters in Korea: Data From the Firefighter Research on Enhancement of Safety & Health (FRESH)

Article information

J Prev Med Public Health. 2019;52(6):345-354

Publication date (electronic) : 2019 October 24

doi : https://doi.org/10.3961/jpmph.19.116

Woojin Kim¹, Munjoo Bae², Sei-Jin Chang³, Jin-Ha Yoon⁴, Da Yee Jeong⁵, Dae-Sung Hyun^3,6, Hye-Yoon Ryu⁷, Ki-Soo Park⁸, Mi-Ji Kim⁸, Changsoo Kim^,1,9

¹Department of Preventive Medicine, Yonsei University College of Medicine, Seoul, Korea

²Department of Occupational and Environmental Health, Yonsei University Graduate School of Public Health, Seoul, Korea

³Department of Preventive Medicine and Institute of Occupational and Environmental Medicine, Yonsei University Wonju College of Medicine, Wonju, Korea

⁴Department of Preventive Medicine and Institute of Occupational Medicine, Yonsei University College of Medicine, Seoul, Korea

⁵Department of Dental Hygiene, Hanyang Women’s University, Seoul, Korea

⁶Department of Biostatistics and Computing, Graduate School, Yonsei University, Seoul, Korea

⁷Department of Preventive Medicine, Yonsei University Wonju College of Medicine, Wonju, Korea

⁸Department of Preventive Medicine and Institute of Health Science, Gyeongsang National University College of Medicine, Jinju, Korea

⁹Institute of Human Complexity and Systems Science, Yonsei University, Incheon, Korea

Corresponding author: Changsoo Kim, MD, PhD Department of Preventive Medicine, Yonsei University College of Medicine, 50 Yonsei-ro, Seodaemun-gu, Seoul 03722, Korea E-mail: preman@yuhs.ac

Received 2019 May 17; Accepted 2019 September 17.

Abstract

INTRODUCTION

It is well-known that firefighters are exposed to hazardous environments that can cause both physical harm and psychological trauma [1,2]. They also experience chronic stress due to sleep disturbances caused by shift work and sustained tension caused by atmospheric working conditions [3]. These physical factors and the associated job stress decrease firefighters’ quality of life and can lead to long-term mental and physical harm [4-6]. Among firefighters, work-related characteristics are considered to be risk factors for respiratory, cardiovascular, and psychiatric disorders [5-7].

Burnout is characterized by chronic emotional exhaustion, interpersonal cynicism, loss of personal identity, and personal and professional ineffectiveness [8-10]. Although burnout is not a medical diagnosis, it can cause adverse physical and psychological effects [11]. Recently, several studies have reported burnout to be prominent among emotional laborers [12], those engaging in dangerous or specialized work, those with high expectations to perform socially moral work, such as nurses and doctors [13,14], and those who have jobs that require a high level of responsibility [15]. A longitudinal study of ambulance workers showed that job-related acute stress was associated with fatigue, burnout, and post-traumatic distress [16].

Persistent and chronic occupational stress and burnout are considered predictors of post-traumatic stress [17,18]. Several studies conducted to identify the association between emotional exhaustion and post-traumatic stress disorder (PTSD) caused by excessive work stress have showed a strong positive correlation between burnout and PTSD [19-21]. Based on the results of these studies, we hypothesized that chronic stress-related burnout could be a risk factor for PTSD, and we attempted to analyze the mutual interrelationships among burnout, PTSD, and other factors that may affect PTSD.

Until recently, relatively few studies have examined the association between burnout and firefighters’ mental health in Korea [22]. Therefore, we investigated the association between burnout due to work-related stress and the risk of PTSD in firefighters. We also explored both the direct and indirect effects of burnout, trauma, and violence on PTSD risk.

In order to confirm the relevant factors of PTSD identified in previous studies conducted among firefighters and to describe the association among the factors in an integrated way, we analyzed the data using structural equation modeling. Based on these findings, we discuss whether experiencing burnout due to work-related stress is a direct or indirect factor influencing PTSD.

METHODS

Survey Instrument

The Web-based survey included questionnaires on basic demographic information (e.g., sex, age, marital status, educational level, and smoking and drinking habits), occupational history (e.g., service experience, rank, main job, and work area), history of exposure to physical and psychological violence, chronic stress factors, shifts, and emotional labor. The Job Content Questionnaire [23], the 12-item General Health Questionnaire [24], and questionnaires addressing organizational climate, emotional demands, trauma experience, and burnout were also included. The analysis was conducted using data related to job-related chronic stress, burnout, exposure to violence, and trauma experience.

Specialized cohorts were primarily subjected to clinical tests to check for cardiovascular disease, cognitive dysfunction, and mental health diseases. The clinical tests included physical measurements, laboratory testing, a cardiovascular examination, a cognitive function test, and a mental health examination. Among these tests of mental health, PTSD was measured using the Posttraumatic Stress Disorder for DSM-5 Checklist (PCL-C) [25], sleep disorders were measured using the Pittsburgh Sleep Quality Index, alcohol dependency was measured using the Alcohol Use Disorder Identification Test-Korea, depressive symptoms were measured using the Center for Epidemiologic Studies Depression Scale, and anxiety disorder was measured using the Beck Anxiety Inventory. The PCL-C score was used in this study.

Job stress was measured with a tool that modified and supplemented the Korean Occupational Stress Scale, which was developed by Chang et al. [26] for Korean employees. In this study, 6 questions across 2 categories—3 for “job demands” and 3 for “effort-reward imbalance (ERI)”—were used (Table 1). Cron bach’s α was 0.754 and 0.791 for the 2 categories, respectively.

Table 1.

Factors used in the final analysis model and Web survey items for each factor

Burnout and trauma experience were measured using 5 and 6 questions, with a 7-point Likert scale and 5-point Likert scale, respectively (Table 1). Cronbach’s α was 0.941 and 0.876 for the 2 categories, respectively. Higher scores indicate higher levels for both burnout and trauma.

Violence was measured using the Korean Workplace Violence Scale [27]. Of the items, 5 questions about experiences of psychological, sexual, and physical violence at the hands of clients were analyzed. Responses were rated on a 4-point Lik ert scale, with higher scores indicating higher exposure to vio lence (Table 1). Cronbach’s α was determined to be 0.842.

PTSD was measured using the PCL-C, which consists of 17 questions. Items 1-5 concern re-experience, 6-12 are related to avoidance, and 13-17 are related to arousal. Cronbach’s α was determined to be 0.892.

Statistical Analysis

In this study, the following statistical procedures were conducted. First, to evaluate the validity and reliability of the latent constructs and to determine the factors in the final analysis model, confirmatory factor analysis was conducted using participants’ responses regarding job stress, burnout, exposure to violence, and experience with trauma. In order to assess the validity of the potential factors to be measured, the standardized factor loadings of the measured variables and the average variance extracted (AVE) values of each factor were checked. Measured variables with standardized factor loadings less than 0.5 were excluded from the analysis for the final model. Next, any factor with an AVE of less than 0.5 was determined to have low convergent validity and was excluded from the analysis. Reliability was verified using Cronbach’s α to assess the internal consistency (0.7 or more) and the construct reliability (CR; 0.7 or more). Finally, we compared the AVE of each latent factor to determine whether it was greater than the square of the correlation coefficient between the latent factors, and we confirmed whether the discriminant validity of the factor was high.

After conducting confirmatory factor analysis to confirm the reliability and validity of the model structure, the final analysis consisted of 6 questions related to job stress, 5 questions related to burnout, 5 questions related to violence exposure, and 5 questions related to trauma experience. A conceptual model was established, which was assessed using structural equation modeling (SEM) (Figure 1). Maximum likelihood estimation was used for analysis, and several fit indices were used to evaluate model fit: the chi-square test, the goodness-of-fit index (GFI; 0.9 or more), the root mean square error of approximation (RMSEA; 0.05 or less), the standard root mean-square residual (SRMR; 0.05 or less), and the expected cross-validation index. Additionally, the comparative fit index (CFI; 0.9 or more), the Tucker-Lewis index (TLI; 0.9 or more), and the normed fit index (NFI; 0.9 or more) were used for the incremental fit index, and the normed chi-square (χ²/degrees of freedom [df], 3 or less) and adjusted goodness-of-fit index (AGFI; 0.9 or more) were used for the parsimonious fit index. After verifying the model fit by using the criteria for evaluation, the path coefficient and statistical significance of each path were determined through pathway analysis.

Figure. 1.

Conceptual framework of the study based on the Effect of Burnout on PTSD Symptoms in Firefighters model. Rectangles indicate observed variables, and ellipses represent latent variables/constructs. Single-headed arrows indicate a directional effe. PTSD, post-traumatic stress disorder; ERI, effort-reward imbalance.

Finally, after performing the bootstrapping hypothesis test (1000 times) to assess whether there was an indirect effect of trauma on PTSD through burnout, a mediation effect analysis was performed using the Sobel, Aroian, and Goodman tests.

The factor analysis, descriptive analysis, internal reliability of the scales, correlations between variables, SEM analysis, and bootstrap estimates were performed with R version 3.5.2 (https://cran.r-project.org/bin/windows/base/old/3.5.2/) using the lavaan package. Mediation effect analyses were calculated using the Sobel test calculator (https://www.quantpsy.org/sobel/sobel.htm).

RESULTS

The general characteristics of the participants are shown in Table 2. Of the 535 participants, 513 (95.9%) were males and 22 (4.10%) were females. By service duty, 46.3% worked in fire-suppression groups, and 32.5% in rescue groups. Participants whose work hours exceeded 40 hr/wk (78.1%) constituted a larger group than those who worked fewer than 40 hr/wk (21.8%). The normality test results for each question showed that the absolute values of skewness and kurtosis were less than 3.0 and 10.0, respectively (Supplemental Material 1), thus satisfying SEM validity [28].

Table 2.

Demographic characteristics of participants (n=535)

Because their standardized factor loadings were smaller than 0.5, we excluded 4 factors (autonomy, interpersonal conflict, job instability, and job culture) that related to job stress. The standardized factor loadings of the measurement variables for job demand, organizational system, ERI, burnout, trauma, and violence were all above 0.6, and they explained each factor well. All 6 factors were compliant with the criteria for AVE, CR, and Cronbach’s α.

For the 6 factors remaining after the above process, the discriminant validity was evaluated. As a result, a correlation was found between the organizational system and ERI; therefore, we excluded the organizational system factor with the lower Cronbach’s α from the analysis model (Supplemental Material 2). Using the above process, the final model was derived (Figure 2).

Figure. 2.

Results from a structural equation model for the Effect of Burnout on PTSD Symptoms in Firefighters with parameter estimates and path diagram for the modified model. The model was fitted to the self-reported data of firefighters collected in the FRESH study (2016-2017). Rectangles indicate observed variables, and ellipses represent latent variables/constructs. Continuous arrows indicate significant effect while dashed arrows signify non-significant effects. PTSD, post-traumatic stress disorder; FRESH, Firefighter Research on Enhancement of Safety & Health; ERI, effort-reward imbalance. *p<0.05, **p<0.01, ***p<0.001.

Concerning model fitness, although the chi-square value was unsuitable, the value of χ²/df was 2.357, which met the conformity criteria. The other absolute fit indices—GFI (0.927), RMSEA (0.049), and SRMR (0.04)—were suitable. The incident fit indices—CFI (0.960), TLI (0.953), and NFI (0.931)—were also suitable. The value of AGFI using df was 0.906, which was appropriate for the model (Supplemental Material 3).

To verify the significance of the model path, parameter estimates for the free parameters, critical ratio, and 2-tailed p-values were evaluated (Table 3). A total of 6 paths were analyzed in this model (Figure 2). Participants who reported higher job demands and lower ERI were more likely to experience higher job burnout than those with lower job demands and a higher ERI. Both occupational stress and trauma experience were significantly associated with burnout. Job burnout and violence from clients were positively related with PTSD; however, trauma experience was not significantly related with PTSD scores (Supplemental Material 4).

Table 3.

Path coefficients estimated using linear regression in a structural equation model

The Sobel test was performed to estimate the significance of the indirect effects of trauma on PTSD through burnout (Supplemental Materials 5 and 6). The effect of trauma on PTSD through burnout was significant (t=2.715, p=0.012). Trauma experience was not directly related to PTSD; however, the higher the degree of trauma, the more PTSD risk indirectly increased with burnout as a mediator. The Aroian (t=2.475, p= 0.013) and Goodman (t=2.551, p=0.011) tests were used to compare with the results of the Sobel test, and a similar association was observed.

DISCUSSION

Until now, most studies on PTSD among firefighters have focused only on job-related traumatic stress [29-31]. However, in this study, we explored the relationship between burnout due to work-related stress and PTSD symptoms in firefighters, and we investigated whether burnout affected PTSD symptoms in the context of a job characterized by violence and trauma. According to our results, firefighters were at high-risk of experiencing burnout and ERI. Interestingly, both burnout and violence affected PTSD symptoms; however, trauma experience was not directly associated with PTSD symptoms.

Among firefighters, in addition to physical trauma, mental stress may impact health. According to the National Fire Service Personnel Psychological Assessment Report, conducted in 2004, in Korea, firefighters are exposed to an average of 7.8 extreme trauma events per year, and PTSD prevalence in this group is 10.5 times that of the general population [32]. Due to the nature of firefighters’ work, they tend to be more vulnerable to secondary PTSD caused by repeated exposure to job-induced stress [18,33], rather than the primary post-traumatic stress that mostly occurs in victims who have directly experienced a traumatic event. However, it is not possible to reduce or avoid the exposure of firefighters to these events in their job environment. Therefore, it is necessary to identify and control the job-related risk factors of PTSD to promote firefighters’ mental health.

We also found that increased burnout caused by work-related stress was significantly associated with an increase in PTSD symptoms. According to a study of 208 firefighters in the southeastern USA, job stress and work-family conflict were associated with increased exhaustion among firefighters [34]. Research in France also showed that job control was negatively related to emotional exhaustion, while job demands were positively related to both emotional exhaustion and depersonalization [35]. Thus, it is suggested that programs aimed to prevent or mitigate burnout among firefighters may help prevent PTSD.

If relief from burnout has a primary effect on post-traumatic stress, PTSD may be prevented by controlling the factors that act as effect modifiers that weaken or enhance the development of burnout under the same stress levels. Therefore, it is necessary to determine the relevant factors through further research. In a recent study, self-efficacy was found to be a significant moderator in the relationship between work stress and burnout, regardless of the level of stress experienced; it was also found that firefighters with low self-efficacy tended to experience exhaustion [36]. In addition, it has been suggested that musculoskeletal symptoms [37] and auditory fatigue [38] may exacerbate factors related to occupational burnout.

Identifying the factors or variables that mediate burnout and PTSD in firefighters can help prevent post-traumatic symptoms resulting from trauma exposure by facilitating interventions to reduce it. According to a study conducted on 109 firefighters in Korea, burnout symptoms in those with a high sense of calling was significantly associated with an increased risk of PTSD [21]. Another study showed that among the subcategories of burnout symptoms, such as depersonalization, emotional exhaustion, and personal accomplishment [39], PTSD risk was significantly associated with depersonalization and job-related musculoskeletal injuries [40].

The most notable finding of our study is that trauma experience had an indirect effect on PTSD in firefighters as mediated by burnout. As mentioned above, given the job that firefighters have, it is not easy to avoid extreme scenes of trauma that leave a psychological aftereffect. However, considering our results, it may be possible to prevent the development of PTSD if occupational exhaustion is controlled for. Thus, it is necessary to improve firefighters’ working conditions to reduce job-related stress, which can cause burnout. Simultaneously, firefighters’ self-efficacy [36] and self-resilience [31] should be fostered to decrease their vulnerability to stress.

Our study has several advantages over earlier studies. First, unlike previous domestic studies that analyzed the relationship between burnout and PTSD in firefighters [21,31], participants in our study were recruited from all over the country, not just from a specific region or a few regions. However, the number of subjects in our study is small and cannot represent the over 40 000 firefighters nationwide; additionally, the regional distribution of our target sample is somewhat different from the actual distribution, so further research is needed to compensate for these limitations. Second, we used standardized study protocols and various clinical and psychological measurements (e.g., face-to-face interviews and Web-questionnaire surveys) that were not commonly used in previous studies.

Our study also has several limitations that must be considered. First, the nature of the cross-sectional design means that we cannot infer causality. In this study, we did not define PTSD-related exposure as the occurrence of specific events at a specific time, but rather as chronic and persistent occurrences within one’s work environment. For this reason, our analysis was conducted to suggest relevance rather than to propose causal relationships between factors. Thus, longitudinal data analysis should be conducted to determine the causality between job-related stress, burnout, and PTSD. Second, because we only examined firefighters, it is difficult to generalize our current results to other occupational groups. Future studies should compare the current results to employees with similar occupational characteristics. Third, a bias may be present due to the “healthy worker effect.” If firefighters with PTSD retire earlier than the average retirement age, or if those who were relatively health-conscious were more involved in the study, the analysis may have produced a lower PTSD score than it actually should have yielded. Finally, we did not control for certain conditions, such as quality of sleep and level of shift work, that may affect participants’ physical and mental health and could function as confounding factors.

Despite its limitations, this study helped clarify the relationship between burnout, trauma experience, and PTSD risk among firefighters in Korea using SEM. Overall, firefighters’ job demands and ERI were related to burnout. Additionally, burnout and psychological, sexual, and physical violence from clients were associated with the PTSD symptoms of these firefighters. There was no direct relationship between firefighters’ experience of trauma and PTSD symptoms; however, burnout mediated the relationship between trauma experience and PTSD.

SUPPLEMENTAL MATERIALS

Article information Continued