The purpose of this study was to assess the reliability and validity of the 3-item version of the Work Engagement Scale (WES-3), which is based on the Job Demands-Resources (JD-R) model and was used in the 5th Korean Working Conditions Survey (KWCS).
This study used data from the 5th KWCS (n = 50,205), which was conducted in 2017 with a sample of the Korean working population. The survey gathered comprehensive information on working conditions to define workforce changes and the quality of work and life. The reliability and internal consistency of the WES-3 were assessed using the corrected item-total correlation and Cronbach's alpha coefficient. Confirmatory factor analysis (CFA) was used to test the construct validity of work engagement. The convergent validity was assessed using the correlation with the WHO-5 well-being index. Correlations between work engagement and JD-R factors were also calculated.
The Cronbach's alpha for work engagement was 0.776, indicating acceptable internal consistency. The model comprising 3 work engagement and 2 burnout items showed an excellent fit (χ2: 382.05, Tucker-Lewis index: 0.984, comparative fit index: 0.994, root mean square error of approximation: 0.043). The convergent validity was significant (correlation coefficient: 0.42). Correlations with burnout and job demands were negligible, whereas correlations with job resources and job satisfaction were weakly positive.
The results of our study confirm that the WES-3 has acceptable reliability and validity.
Citations
In firefighters, smoking management is important because they are exposed to various harmful substances in their occupational environment. Accurate surveys of smoking status are essential to control tobacco use. The main disadvantage of self-report questionnaires, which are commonly used for investigating smoking status, is the possibility that the subjects' response are invalid. If the validity of firefighters' answers on smoking questionnaires is not adequate, different methods will be needed for investigating smoking status in firefighters.
This study was conducted on 445 male firefighters from 9 fire stations in Daegu (the city in South Korea) who visited a medical institution for medical checkup in 2016. The urine cotinine test strip (DCT-102; CLIAwaived Inc., cut-off value = 200 ng/mL) was used to classify the actual smoking status and to assess the validity of self-reported smoking status on questionnaires. The sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) of the smoking questionnaires were analyzed. Subjects testing positive in the urine cotinine test (assumed the actual current smokers) were selected. The frequency at which actual current smokers were misclassified as current non-smokers by the questionnaire was calculated. Subjects' characteristics were analyzed for possible association with any discrepancy between self-reported smoking status and urine cotinine test results.
The smoking rates among firefighters surveyed using the smoking questionnaire and the urine cotinine test were 22.47% and 51.24%, respectively. Of the all subjects, 29.66% (n = 132) were misclassified. The sensitivity of the smoking questionnaire was 42.98%, the specificity was 99.08%, the PPV was 98.00%, and the NPV was 62.32%. In the 228 subjects classified as current actual smokers by the urine cotinine test, 57.02% (n = 130) were misclassified on the questionnaire. The misclassification rate increased with age. The degree of misclassification also increased when subjects had a history of disease.
In present study, the validity of the smoking questionnaire for firefighters was not suitable for investigating smoking status due to low sensitivity. To increase the validity of smoking status monitoring in firefighters, consideration of the various factors like survey environment, subjects' characteristics, and occupational factors is needed.
Citations
No tool is available for the multidimensional measurement of workplace well-being among Korean workers. In this study, the Workplace Positive emotion, Engagement, Relationships, Meaning, and Accomplishment (PERMA)-Profiler, a multidimensional workplace well-being measure, was translated into Korean, and its validity and reliability were assessed.
The Workplace PERMA-Profiler, including the positive emotion, engagement, relationships, meaning, and accomplishment domains, was translated according to international guidelines. The questionnaires included the Workplace PERMA-Profiler, Mental Health Continuum-Short Form, Utrecht Work Engagement Scale, Maslach Burnout Inventory-General Survey, Psychosocial Well-being Index-Short Form, and Korean Occupational Stress Scale-Short Form. A total of 316 Korean workers completed a web-based survey with adequate response. Cronbach's alpha values were calculated to assess scale reliability, and correlational and confirmatory factor analyses were used to assess validity.
Cronbach's alpha values for the Korean Workplace PERMA-Profiler ranged from 0.70 to 0.95. Confirmatory factor analysis indicated that the 5-factor model had a marginally acceptable fit [χ2(80) = 383.04, comparative fit index = 0.909, Tucker-Lewis index = 0.881, root mean square error of approximation = 0.110, and standardized root mean square residual = 0.054]. The 5-factor PERMA domains were correlated positively with work engagement and mental well-being in life, and negatively with burnout, occupational stressors, and stress responses. These results showed that the Workplace PERMA-Profiler has good convergent and divergent validity.
The Korean version of the Workplace PERMA-Profiler had good reliability and validity. It might be used as an indicator or evaluation tool for positive mental health interventions in the workplace.
Citations
Since the night time work was introduced as a ‘harmful factor’ for the worker's special health examination (WSHE) in 2014, the validation of the questionnaire used for screening gastrointestinal (GI) disorder has not been conducted. The purpose of this study is to verify the validity of the questionnaire using the data of specific health screening cluster.
We used WSHE screening data for 3 years, from 2014 to 2016, in health screening cluster. The subjects who had received upper GI endoscopy in opportunistic screening and WSHE simultaneously regardless of the results of the questionnaire were selected. We tested the validity of the questionnaire using upper GI endoscopy as a gold standard.
This study was conducted on 5,057 examinees in 2014, 8,352 examinees in 2015, and 10,587 examinees in 2016. The validity of the questionnaire for each year was as follows: sensitivity 12.3% (95% confidence interval [CI], 11.1–13.4), specificity 88.6% (95% CI, 87.2–90.1), accuracy 41.1% (95% CI, 39.8–42.5) in 2014, sensitivity 5.9% (95% CI, 5.2–6.5), specificity 93.6% (95% CI, 92.7–94.4), accuracy 38.6% (95% CI, 37.6–39.6) in 2015, sensitivity 6.0% (95% CI, 5.4–6.5), a specificity of 9.42% (95% CI, 93.4–95.0), accuracy of 34.2% (95% CI, 33.3–35.1) in 2016. In generally, questionnaire showed sensitivity of 10%, specificity of 90%, and accuracy of 40%.
Despite the purpose of WSHEs aiming to identify target disease early, the sensitivity of the questionnaire for GI disease was too low as 10%. The reasons for this are the problem of the question itself, and the problem of ambiguous target disease. In the future, the questionnaire should be improved to meet the purpose of the WSHE, and further correction of the target disease should be made.
Many studies show that organizational justice (OJ) is related to psychological determinants of employee health. To prevent health problems related to OJ in Korean workplaces and to accurately measure OJ, we developed the Korean version of the Organizational Justice Questionnaire (K-OJQ) and assessed its validity and reliability.
A questionnaire draft of the K-OJQ was developed using back-translation methods, which was preliminary tested by 32 employees in Korea. Feedback was received and the K-OJQ was finalized. This study used data from 303 workers (172 males, 131 females) in Korea using the K-OJQ, job stress, and lifestyle questionnaires.
Cronbach’s α coefficients of the internal consistency reliability was 0.92 for procedural justice and 0.94 for interactional justice. Factor analyses using SPSS 24 and Amos 23 extracted two expected factors, named procedural justice (7 items; range, 1.0–5.0) and interactional justice (6 items; range, 1.0–5.0) and showed a reliable fit (χ2 = 182;
The K-OJQ was objectively validated through statistical methods.
The online version of this article (10.1186/s40557-018-0238-8) contains supplementary material, which is available to authorized users.
Citations
The purpose of this study is to assess the validity and reliability of general job satisfaction (JS) in the Korean Labor and Income Panel Study (KLIPS).
We used the data from the 17th wave (2014) of the nationwide KLIPS, which selected a representative panel sample of Korean households and individuals aged 15 or older residing in urban areas. We included in this study 7679 employed subjects (4529 males and 3150 females). The general JS instrument consisted of five items rated on a scale from 1 (strongly disagree) to 5 (strongly agree). The general JS reliability was assessed using the corrected item-total correlation and Cronbach’s alpha coefficient. The validity of general JS was assessed using confirmatory factor analysis (CFA) and Pearson’s correlation.
The corrected item-total correlations ranged from 0.736 to 0.837. Therefore, no items were removed. Cronbach’s alpha for general JS was 0.925, indicating excellent internal consistency. The CFA of the general JS model showed a good fit. Pearson’s correlation coefficients for convergent validity showed moderate or strong correlations.
The results obtained in our study confirm the validity and reliability of general JS.
Citations
Citations
Citations
Citations
Citations
Citations
Citations
Citations