- Open Access
Comprehensive psychometric examination of the attitudes towards suicide (ATTS) in South Korea
International Journal of Mental Health Systems volume 10, Article number: 2 (2016)
The aim of this study is to examine the validity and reliability of the Korean version of attitudes towards suicide (ATTS) on a group of university students, which would contribute to the evaluation of the ATTS as a useful tool of measuring attitudes toward suicide in South Korea with very high suicide rates.
The subjects of the study were 195 undergraduates at Chung-Ang University, South Korea in 2013. The measure for assessing public attitudes towards suicide was ATTS made up of 34 items in English and the Korean version of it was produced by forward and backward translation procedure. To identify any factors unique to South Koreans’ attitudes towards suicide, we applied exploratory factor analysis (EFA) to the data from 195 university students and was followed by confirmatory factor analysis (CFA) to assess construct validity of the Korean version. The internal consistency of the scale was assessed using Cronbach’s α and the assessment of the test–retest reliability was performed by intraclass correlation coefficients.
On the EFA analysis, were excluded, the tool had 11 factors (32 items), accounting for 62.99 % of the total variance in participants’ responses. CFA failed to support 11-factor model of the scale. Six out of 11 factors were acceptable in terms of both internal consistency and test–retest reliability.
Six factors of the Korean version of the ATTS had acceptable content validity and reliability. However, on the whole, it did not have good construct validity and thus further investigations are needed to develop a scale measuring true public attitudes toward suicide in South Korea.
Measuring the attitudes toward suicide has been a long term interest for those who have been specializing in suicide [1–5]. ‘Attitudes toward suicide (ATTS)’ is influenced not only by an individual factor such as the character, sex, age, residential types, experience related to suicide, contact with a suicidal person, personal beliefs and so on but also by culture, social role and even by the instrument used to measure it [6–14]. As the attitude is influenced by diverse factors, it is extremely difficult to measure attitude for suicide accurately.
Nevertheless, this is a very important matter because by being able to measure the attitude, we can find vulnerable people to suicide and a group or community requiring suicide prevention. And also, measuring of attitude toward suicide could be an evaluation tool for the effectiveness of an suicide prevention education program and helps to develop an community suicide prevention program through improved awareness of suicide [1, 2].
Among them, the most representative and widely used tool is the following three: suicide opinion questionnaire (SOQ), the suicide attitude questionnaire (SUIATT) and ATTS . Of them, we chose ATTS to look for an appropriate scale measuring South Koreans’ attitudes towards suicide. A psychometric test of the Korean ATTS would be added to the evidence from a few studies regarding that of ATTS [10, 15, 16].
The aim of this study is to examine the validity and reliability of the ATTS on a group of university students, which would contribute to the evaluation of ATTS as a useful tool of measuring attitudes toward suicide in South Korea with very high suicide rates.
The target subjects of the study were 241 undergraduates, including 105 pre-medicine undergraduates who took the cultural subject course “Modern Society and Health,” at Chung-Ang University, Seoul, Republic of Korea in 2013. 195 students (80.9 %) of the total subject population agreed to fill out a self-reported questionnaire, whereas 46 undergraduate students were unable to participate as they were in absence from class. The questionnaire included 34 items from the ATTS and were added 4 demographic items such as sex, age, major and the university year. The Institutional Review Board of Chung-Ang University approved the protocol, survey instruments, and consent document for this study (IRB no. 1041078-201311-HR-0093-02).
Instrument and procedure
The ATTS was developed through two survey studies conducted in 1986 and 1996 . The first version of ATTS was developed in 1986 based on the SOQ  and was expanded in the second 1996 study to reflect related atti-tudinal studies. ATTS was predominantly used in Europe to measure the attitudes toward suicide [16, 17], but in recent years has been used globally including within Asian countries such as South Korea and Japan [8, 10, 11, 13, 18], as well as Africa [9, 19] and others. In this study, we adopted the second version of ATTS which has better validity and reliability than its first version .
Exploratory factor analysis (EFA) of ATTS version 2 yielded 10 interpret-able factors, which accounts for 60 % of the total variance and Cronbach’s α coefficients for those factors ranged from 0.38 to 0.86 [2, 8, 10, 11, 14–16].
The ver-sion 2 in 1996 contained a total of 34 items . These were scored on a five-point Likert scale (agree completely, agree to a large extent, doubtful, do not agree and agree not at all). For easier comprehension, this study applied a reversed scoring system. For example, the participant’s answer of “agree completely” to the item “Suicide understandable if severe, incurable disease-people” would correspond to the minimum score of one according to the original scoring system, but is scored the maximum of five in this study. Therefore the stronger the participant felt about a particular subject, the higher their score would become.
For this study, the original second version of ATTS with 34 items was translated into Korean using a forward and backward translation. The process for a forward–backward translation of ATTS and its psychometric testing, which occurred between November 16 and December 2, 2013.
Firstly, the forward translation of the English version of the ATTS into Korean was undertaken by a psychologist and a psychiatrist. Then, the researchers reviewed these two versions and reached a consensus on the Korean draft version. Secondly, a Korean–Australian bilingual expert, translated the draft back into English. The translator and the researchers compared the backward-translated English version with the original one in terms of conceptual equivalence, and then the Korean version was revised slightly. Through this process, the Korean version was completed and made available for the validity and reliability assessment.
To identify any factors unique to Koreans’ attitudes, EFA was performed with the Korean version of ATTS and then, confirmatory factor analysis (CFA) applied with the Korean version using the number of factors resulted from the EFA earlier, to examine its structural validity. We performed EFA to extract factors using the principal component analysis (PCA) with promax rotation and factor loading >0.4 on each item was considered to belong to the corresponding factors . The internal consistency of the preliminary version of ATTS was assessed using Cronbach’s α, and intraclass correlation (ICC) coefficients was used to assess test–retest reliability. ICC coefficients were interpreted with the following criteria: ICC coefficients <0.4, poor; 0.4< ICC coefficients <0.75, fair or good, ICC coefficients >0.75, excellent . The assessment of the test–retest reliability was performed by administrating the questionnaire after a month to 71 consenting pre-medical undergraduate students. A 1 month interval was deemed sufficient since it was greater than the minimum of 2 weeks required for a wash-out effect of the previous questionnaire .
For CFA analysis, indices that were used to assess the fit of the model included: (1) X2-value/degree of freedom (df); (2) normed fit index (NFI); (3) Tucker-Lewis index (TLI); (4) Parsimony Normed Fit index (PNFI); (5) Root mean square error of approximation (RMSEA). With large samples, X2/df ratio of two or less is recommended for interpreting good fit. Cut-off value for interpreting good fit for the NFI and the TLI are 0.90. The recommended cut-off value for the PNFI is 0.80. Recommendations for interpreting fit for the RMSEA are <0.05 for good fit and between 0.05 and 0.08 as adequate fit [23, 24].
All analyses were performed using IBM’s SPSS Statistics 20.0 and AMOS 21.0 for Windows. A p value of under 0.05 was considered statistically significant.
The general demographical characteristics of the study subjects are shown in (Table 1). In a total of 195 participants, approximately 17 % more men (58.5 %) participated than women (41.5 %). Most participants (58.5 %) were between 20 and 24 years of age, and the proportions of first, second, third, and fourth-year students were 45.1, 35.9, 5.6, and 13.3 %, respectively. Pre-medical students accounted for 46.2 %, social science for 20.0 %, natural science for 20.5 %, and art and human science for 13.3 % (Table 1).
As shown in Table 2, after the exclusion of two items with factor loadings <0.4, EFA revealed the following 11 interpretable factors: (1) Acceptability (2) Acceptability related incurable disease (3) Preventability (4) Tabooing (5) Unpredictability (6) Normal–common (7) Aging (8) Incomprehensibility (9) Suicidal process (10) Non-communication (11) Relation-caused (Table 2).
The 11 factors explained 62.9 % of the total variance and contained 32 of 34 items. Factor 1 and Factor 2 consist of items on the acceptability of suicide. Factor 2 focuses on the questions of the acceptability of suicide in those with incurable disease on two separate levels, one as the subject, that is myself or as the third person who is assumed to suffer from an incurable disease with the question raised being whether suicide is acceptable. Factor 3 is a section on the preventability of suicide and Factor 4 is composed of items related to the taboo of suicide: ‘Should or would rather not talk about suicide’, ‘Risk to evoke suicidal thoughts if asked about’. Factor 5 describes the unpredictability of suicide and Factor 6 consist of questions about whether suicide is Normal–common. The results of EFA analysis with Factor and their respective items are detailed in (Table 2).
Confirmatory factor analysis
After EFA, we performed CFA again with 11-factor model from the results of the EFA in our sample (Table 3). The CFA result value calculated by each of the indicators is as follows: X2/df = 1.93, NFI = 0.57, TLI = 0.63, PNFI = 0.44 and RMSEA = 0.07. With the exception of RMSEA, fit statistics were still below recommended cutoff values indicating the degree of fit was poor despite the slightly improved TLI comparing with the results of CFA using 10 factors shown in original version. Therefore, structural validity of the Korean version of ATTS is not good for the given data.
The Cronbach’s α for the Korean version of the ATTS is 0.657 which being greater than 0.6, can be interpreted as having acceptable internal consistency as according to the general consensus on the cutoff value. Cronbach’s α values for the total 32 items ranged between 0.309 and 0.781, with all factors’ Cronbach’s α value greater than 0.3. (Table 2).
Factor 2 which comprises of items on acceptability related to incurable diseases had the highest value of 0.781, and Factor 1 which comprises of items on whether suicide is acceptable followed with 0.762. Factor 4 is composed of items related to the taboo of suicide followed with 0.560, then Factor 3 is a section on the preventability of suicide followed with 0.530. Factor 6 had Cronbach’s α of 0.516 and Factor 5 had Cronbach’s α of 0.497. Factor 7 contained 1 item that related to Aging followed with 1.0, Factor 9 with Cronbach’s α of 0.380, Factor 11 with Cronbach’s α of 0.364 and Factor 8 with Cronbach’s α of 0.339. Factor 10 had the lowest Cronbach’s α of 0.309.
The Korean version of the ATTS showed an excellent overall test–retest reliability, with an ICC coefficients of 0.782 (p < 0.001) and ICC coefficients values greater than 0.7 for 5 out of 11 factors (Factor 1–3, 6 and 9). The highest test–retest reliability was shown in Factor 1 with ICC coefficients value of 0.832, then Factor 3 with ICC coefficients value of 0.771. Factor 6 with ICC coefficients value of 0.758, Factor 2 with ICC coefficients value of 0.750 and Factor 9 with ICC coefficients value of 0.748. The lowest of the 11 factors was Factor 11 with a value of 0.354. The internal consistency and Cronbach’s α values for each factor, as well as the ICC coefficient values for the entire 11 factors of the ATTS are detailed in (Table 2).
The objective of this study was to report the reliability and validity of a Korean version of the ATTS, administered to a sample of university students. EFA was performed on the Korean version to yield 11 factors including 32 items, but CFA failed to support 11-factor model of the scale. Six out of 11 factors were acceptable in terms of both internal consistency and test–retest reliability.
There are disagreements in many factors except few factors on EFA results of the Korean version and the original version of the ATTS . For example, factor 11 (Relation-caused) of the Korean version has a total of two similar items to those of the original version. An intriguing one of such differences is the case that in the original version ‘suicide a right’ and ‘suicide regarding the case of an incurable disease’ included a same factor while they were separated in the Korean version. The reason for that is because western countries have had euthanasia debates in popular for a long time while South Korea have rarely made public discussions over this topic .
On the CFA after EFA, the Korean version was not fitted to 11-factor model. This result is similar to an Iranian and a Japanese study which performed CFA whether ATTS translated by their own language to fit 10-factor model [10, 15]. Various models based on the number of factors (2–15) of SOQ also have not satisfied to meet the demand levels of construct validity indices on CFA . One of major reasons why those scales for ATTS have not a stable latent structure would be because items regarding fact and attitudes mixed in a same measure .
Although the Korean version has not been proved to have good construct validity in this study, 6 factors (Factor 1–6) on EFA results have acceptable content validity and reliability. For example, all items of factor 2 have concerned with ATTS in incurable diseases case. It means that each factor approximately have acceptable content validity. In particular, six factors (factor 1 ~ 6) have acceptable internal consistency and test–retest reliability, using the criteria of 0.5 as an acceptable minimal level of Cronbach’s α and using that ICC were interpreted with the following criteria: ICC <0.4, poor; 0.4< ICC <0.75, fair or good, ICC >0.75, excellent [26, 27]. If necessary, those factors could be applied in a South Korean setting despite of the risk of poor construct validity on the whole.
However, many researchers emphasize that instrument for the psychometric properties must be multi-dimensional to measure different attitudes areas of human psychology various [27–29]. Furthermore, public attitudes towards suicide in a society would be affected by its own culture and value. In this vein, a tool for attitudes toward suicide, including various dimensions and considering South Koreans’ culture and value, need to be developed. There are some limitations to the interpretation of the results in that the study. For example, target participants was only university students of one university in Seoul. However, this study is the first validity and reliability study of ATTS in South Korea.
The present study showed that the reliability and validity of ATTS was an acceptable tool to measure ATTS in Korea, despite few factors having very low Cronbach’s α. Thus additional research for reliability is needed.
Diekstra RF, WHO. Suicide and its prevention: the role of attitude and imitation. Netherlands: Brill; 1989.
Kodaka M, Poštuvan V, Inagaki M, Yamada M. A systematic review of scales that measure attitudes toward suicide. Int J Soc Psychiatry. 2011;57:338–61.
Anderson AL, Lester D, Rogers JR. A psychometric investigation of the suicide opinion questionnaire. Death Stud. 2008;32:924–36.
Diekstra R, Kerkhof A. Attitudes toward suicide: development of a suicide attitude questionnaire (SUIATT). In: Current issues of suicidology. Berlin: Springer; 1988. p. 462–76.
Domino G, Moore D, Westlake L, Gibson L. Attitudes toward suicide: a factor analytic approach. J Clin Psychol. 1982;38:257–62.
Domino G, Gibson L, Poling S, Westlake L. Students’ attitudes towards suicide. Soc Psychiatry. 1980;15:127–30.
Domino G. Altering attitudes toward suicide in an abnormal psychology course. Teach Psychol. 1980;7:239–40.
Foo XY, Alwi MNM, Ismail SIF, Ibrahim N, Osman ZJ. Religious commitment, attitudes toward suicide, and suicidal behaviors among college students of different ethnic and religious groups in Malaysia. J Relig Health. 2014;53:731–46.
Hjelmeland H, Akotia CS, Owens V, Knizek BL, Nordvik H, Schroeder R, et al. Self-reported suicidal behavior and attitudes toward suicide and suicide prevention among psychology students in Ghana, Uganda, and Norway. Crisis. 2008;29:20.
Kodaka M, Inagaki M, Poštuvan V, Yamada M. Exploration of factors associated with social worker attitudes toward suicide. Int J Soc Psychiatry. 2013;59:452–9.
Kodaka M, Inagaki M, Yamada M. Factors associated with attitudes toward suicide: among Japanese pharmacists participating in the board certified psychiatric pharmacy specialist seminar. Crisis. 2013;34:420.
Medina CO, Jegannathan B, Dahlblom K, Kullgren G. Suicidal expressions among young people in Nicaragua and Cambodia: a cross-cultural study. BMC Psychiatry. 2012;12:28.
Nebhinani M, Nebhinani N, Tamphasana L, Gaikwad AD. Nursing students’ attitude towards suicide attempters: a study from rural part of northern India. J Neurosci Rural Pract. 2013;4:400.
Norheim AB, Grimholt TK, Ekeberg Ø. Attitudes towards suicidal behaviour in outpatient clinics among mental health professionals in Oslo. BMC Psychiatry. 2013;13:90.
Mofidi N, Ghazinour M, Salander-Renberg E, Richter J. Attitudes towards suicide among Kurdish people in Iran. Soc Psychiatry Psychiatr Epidemiol. 2008;43:291–8.
Renberg ES, Jacobsson L. Development of a questionnaire on attitudes towards suicide (ATTS) and its application in a Swedish population. Suicide Life Threat Behav. 2003;33:52–64.
Renberg ES, Hjelmeland H, Koposov R. Building models for the relationship between attitudes toward suicide and suicidal behavior: based on data from general population surveys in Sweden, Norway, and Russia. Suicide Life Threat Behav. 2008;38:661–75.
Kim K, Park JI. Attitudes toward suicide among college students in South Korea and the United States. Int J Ment Health Syst. 2014;8:17.
Rodríguez AH, Caldera T, Kullgren G, Renberg ES. Suicidal expressions among young people in Nicaragua. Soc Psychiatry Psychiatr Epidemiol. 2006;41:692–7.
Lee WY, Ahn J, Kim JH, Hong YP, Hong SK, Kim YT, et al. Reliability and validity of a self-reported measure of medication adherence in patients with type 2 diabetes mellitus in Korea. J Int Med Res. 2013;41:1098–110.
Shrout PE, Fleiss JL. Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 1979;86:420.
Wolf OT, Neumann O, HELLHAMMER DH, Geiben AC, Strasburger CJ, Dressendörfer RA, et al. Effects of a two-week physiological dehydroepiandrosterone substitution on cognitive performance and well-being in healthy elderly women and men 1. J Clin Endocrinol Metab. 1997;82:2363–7.
Hu LT, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Model. 1999;6:1–55.
Grimholt TK, Haavet OR, Jacobsen D, Sandvik L, Ekeberg O. Perceived competence and attitudes towards patients with suicidal behaviour: a survey of general practitioners, psychiatrists and internists. BMC Health Serv Res. 2014;14:208.
Harris NM. The Euthanasia Debate. J R Army Med Corps. 2001;147:367–70.
Jenner JA, Niesing J. The construction of the SEDAS: a new suicide-attitude questionnaire. Acta Psychiatr Scand. 2000;102:139–46.
Guilford JP. Psychometric methods. 1954.
IH NJB. Psychometric theory. New York: McGraw Hill; 1994.
Myers DG. Social psychology. New York: McGraw-Hill; 1987.
NJ and WY designed the study. NJ collected the data as a member of the research project, performed the statistical analysis and drafted the original paper. WY and YP revised the paper. All authors read and approved the final manuscript.
We would like to acknowledge the contributions made by Seung Mi Yun and Kun Kwak in data collection and handling and editing articles. The comments from two reviewers have been found to be useful in improving the revised version of the paper. The authors would like to thank students for their participation in this study. We’d like to give Dr Renberg many thanks for permission to use the original version of ATTS. This study was supported by the Health Promotion Fund of the Ministry of Health and Welfare, Republic of Korea (Code 13-16).
The authors declare that they have no competing interests.
About this article
Cite this article
Ji, N., Hong, Y. & Lee, W. Comprehensive psychometric examination of the attitudes towards suicide (ATTS) in South Korea. Int J Ment Health Syst 10, 2 (2016) doi:10.1186/s13033-016-0035-0
- Attitude to death
- Reliability and validity