Skip to main content

Poly-victimisation and health risk behaviours, symptoms of mental health problems and suicidal thoughts and plans among adolescents in Vietnam

Abstract

Background

Limited evidence is available about poly-victimisation (exposure to multiple forms of victimisation) and mental health among adolescents in low and lower-middle-income countries. The aim of this study was to examine the associations between lifetime exposure to poly-victimisation, health risk behaviours, symptoms of common mental health problems and suicidal ideas in the previous year among high school students in Vietnam.

Methods

Participants were high school students in rural and urban districts of Hanoi, Vietnam. The data source was an anonymously-completed structured self-report survey. Lifetime exposure to poly-victimisation was assessed using the juvenile victimisation questionnaire revised 2 (JVQ R-2); mental health symptoms by the depression, anxiety and stress scale-21 (DASS-21); involvement in health risk behaviours and previous year suicidal thoughts and plans by questions adapted from the 2013 youth risk behaviour survey. Data were collected between October, 2013 and January, 2014 and were analysed using generalised structural equation modelling.

Results

In total 1616/1745 (92.6 %) eligible students provided complete data. Prior year suicidal thoughts were reported by 21.4 % (95 % CI 18.5–24.5 %) of the female respondents and 7.9 % (95 % CI 6.2–9.8 %) of the male respondents. Prior year suicidal plans were reported by 7.8 % (95 % CI 5.9–9.8 %) of the girls and 4.0 % (95 % CI 2.7–5.3 %) of the boys. Poly-victimisation was associated with increased likelihood of involvement in health risk behaviours and symptoms of common mental health problems among both sexes, which increased adolescents’ risk of having suicidal ideas in the previous year. Compared to non-victims or victims of fewer forms, poly-victims were also more likely to report suicidal thoughts and plans among both girls and boys (p < 0.05).

Conclusions

Overall, the results revealed that poly-victimisation was associated with increased involvement in health risk behaviours, poorer mental health and increased risks of suicidal ideas among Vietnamese adolescents. Suicidal ideas were prevalent among the students. Interventions to assist victims of violence and prevention of violence, especially poly-victimisation, among adolescents in Vietnam is therefore important.

Background

Mental health problems, including depression and anxiety, are among the top five leading causes for burden of disease among adolescents (people aged 10–19 years) [1]. It is estimated that at least one in ten children and adolescents worldwide are affected by mental health problems in their lifetimes [2, 3]. Among adolescents, mental and behavioural disorders accounted for more than 17 % of the total 84.3 million daily adjusted life years lost in 2012 [4]. Adolescents rank mental health problems as the most important health problems for people of their age [1]. Suicide is reported to be one of the top five leading causes of death among adolescents worldwide [3]. In 2012, about seven per 100,000 adolescents died by suicide [5].

Mental health problems and suicidal behaviours are multi-factorially determined [2]. Risk factors include family, school, neighbourhood and social circumstances as well as individual characteristics. These include experiences of adverse life events [6], parental divorce [7, 8], childhood maltreatment and neglect at home [9], bullying at school [10] and neighbourhood violence [11]. For those living in resource-constrained countries, experiences of natural disasters [12], forced displacement [13], armed conflict and war [14] and poverty [15] are additional risk factors [16]. Common, non-psychotic mental health problems and suicidal behaviours are generally found to be more prevalent among girls than boys [16, 17].

In general interpersonal violence is harmful to mental health, including among young people. Investigations of exposure to individual forms of violence including physical, emotional or sexual maltreatment among children and adolescents, have found that these are associated with an increased likelihood of health risk behaviours such as alcohol consumption, illicit drug use, tobacco smoking, and sexual activity with multiple partners. Experiences of violence are also associated with an increased risk of suicidal behaviours [1820].

Most previous investigations of the effects of violence on mental health have been limited to individual forms of victimisation. However, this approach has been criticised for ignoring the potential interactions among different forms of victimisation and accrued experiences of multiple forms of victimisation [21, 22].

In 2005, Finkelhor et al. introduced the concept of “poly-victimisation”, which referred to the co-occurrence of multiple forms of victimisation, including physical, emotional or sexual maltreatment, neglect, robbery, theft, property vandalism, threat or assault, peer or sibling victimisation, witnessing of family or community violence, exposure to gun shooting, bombing and cyber bullying [23, 24]. The juvenile victimisation questionnaire (JVQ) was developed and validated for use as a tool to assess poly-victimisation among children and adolescents in the USA [23, 25]. The scale comprises 34 questions about different forms of victimisation. A total score can be created as the sum of these 34 questions. Since the introduction of the JVQ, it has been used in diverse settings, including in Finland [26], Spain [27], China [28, 29], Pakistan [30] and Vietnam [31]. There have, however, been variations among studies in terms of the criteria used for determination of poly-victimisation. Originally, Finkelhor et al. recommended the use of a cut-off score of four or more to define poly-victimisation when experiences in a one-year period were sought [21, 25]. When lifetime experiences were examined, these authors proposed classifying the top 10 % of the sample with the highest scores on the JVQ (indicating exposure to the most number of victimisation forms) as poly-victims [32]. This led to the use of a cut-off score of 11 or more in some studies in the USA [33], eight or more in a Spanish study [34] and five or more in a Finnish study [26]. Some subsequent studies used a cut-off score of four or more [28] or 11 or more [31], which was not based on the criterion of the top 10 % of the sample, but to allow comparison with other studies. In all studies, determination of poly-victimisation was based on the total JVQ score and not on consideration of frequency or intensity of the victimisation experiences.

Despite these variations among studies, there is growing evidence that poly-victimisation is experienced by children and adolescents in high- and upper-middle income countries [26, 28, 32] and has a more substantial adverse impact on victims’ mental health, including suicidal behaviours [21, 22, 28, 3436], than single forms of victimisation. Specifically, when poly-victimisation is accounted for in analyses, the associations between individual forms of victimisation and mental health problems are reduced significantly; or even eliminated [35]. Most research about poly-victimisation and its association with the mental health of children and adolescents has been conducted in these countries and there is only limited evidence available about the experiences of those who live in low and lower-middle-income countries [37].

Vietnam is a densely-population lower-middle income country with more than 16 million adolescents [38]. Secondary analyses of data contributed by nationally representative samples of adolescents aged 14–19 in the Survey Assessments of Vietnamese Youth (SAVY) 1 (2004–05) and 2 (2009–10) [39] revealed that victims of severe physical violence perpetrated by family members or non-family members were more likely to have feelings of low mood or suicidal thoughts compared to non-victims [17]. Among a sample of 972 Vietnamese students aged 12–15 years, Phuong et al. [40] found that violence was associated with health risk behaviours. Witnessing physical violence between their parents was associated with an increased risk of riding a motorbike at an illegal age (less than 18); and conflict with sibling(s) was associated with a higher likelihood of drinking alcohol for adolescent girls and boys. Among adolescent boys being bullied was associated with a higher risk of suicidal thoughts. Nguyen et al’s [9] investigation of 2591 students aged 12–17 in Vietnam demonstrated a dose–response relationship between exposure to more forms of child maltreatment (including emotional, physical, sexual maltreatment and neglect) and lower self-esteem and symptoms of depression and anxiety. This study was the first in this setting to examine different forms of child maltreatment. Nevertheless, it was still limited to maltreatment; other types of victimisation including dating violence or cyber bullying were not investigated.

These studies also have methodological limitations [3942] which affect generalisation of the results. Participants [9, 40] were recruited from public schools, which are only one of the three main types of schools (public, private and centres for continuing education) in Vietnam. Exposure and outcomes in these existing studies were assessed by study-specific questions, not standardised measures, which made it difficult to compare the findings with those reported elsewhere. Important forms of victimisation such as peer or sibling victimisation, witnessing of family or community violence, property vandalism, Internet harassment and dating violence, and adolescent mental health and suicidal thoughts and plans were not assessed. They were limited to investigating up to three forms of victimisation. Overall therefore significant evidence gaps about poly-victimisation and Vietnamese adolescents’ mental health remain.

The aim of this study was to investigate the relationships between experiences of poly-victimisation, health risk behaviours, symptoms of mental health problems, and suicidal thoughts and plans among high school students in Vietnam.

Methods

The methods have been described in detail elsewhere [43] and are summarised here.

Settings and study sites

The study was conducted in Hanoi—the national capital of Vietnam. Study sites were four public high schools, four private high schools and two centres for continuing education. These schools cater to young people of varied academic capabilities. Students attending centres for continuing education are often from more disadvantaged families.

Participants

The inclusion criteria were to be a student aged 16–18 (grade 10–12), literate in Vietnamese and attending the selected schools and centres. All eligible students were invited to participate.

Data sources

Data for the study were collected using an anonymous, self-completed 86-item questionnaire, which included both study-specific questions and standardised measures.

Social and family circumstances participants’ demographic characteristics, including sex (female/male), residential area (rural/urban), family compositions (both parents/single parent/none of the parents), family relationship (unhappy/happy); having a chronic disease or disability (yes/no) and school sector (public/private/centre for continuing education) were assessed using study-specific questions. Experience of adverse life events were assessed using 14 fixed-choice yes/no questions recommended by Turner and Butler [6] and included exposure to fire or natural disasters, severe traffic accidents, severe illnesses, homelessness, parental unemployment, parental incarceration and death of close friends or relatives.

Lifetime exposure to poly-victimisation was assessed using the juvenile victimisation questionnaire revised 2 (JVQ R-2) Youth Self-reported Screener Version [44]. The JVQ R-2 has 34 items [33], assessing lifetime exposure to property victimisation, threat, assault, child maltreatment, peer or sibling victimisation, sexual assault, witnessing of family or community violence. Three JVQ-R2 supplemental items [33] assessing lifetime exposure to violence between family members, not just the parents, and cyber victimisation were added, making a total of 37 items. The juvenile victimisation questionnaire and its revisions have been widely used to assess violence against children and adolescents [21, 2628, 33, 45, 46]. It has been shown to be reliable, acceptable and valid for use among US children and adolescents with internal consistency Cronbach alpha of 0.80 and the test–retest agreement of 95 % (range 77–100 %) [23], but had not been validated for use among Vietnamese adolescents.

Health risk behaviours were assessed using six items from the Youth Risk Behaviours Survey (YRBS) 2013 [47] assessing tobacco smoking, drinking alcohol, illegal drug use, physical fighting, carrying a weapon and having two or more sexual partners. A “yes” response to each of these items was categorised as involvement in health risk behaviours and a “no” non-involvement. Similar items had been found in prior research to be meaningful and acceptable to Vietnamese adolescents aged 12–17 [48].

Stress, anxiety and depression symptoms were assessed using the Vietnamese validation of the depression, anxiety and stress scale-21 (DASS-21-V) [49, 50]. This scale has been formally validated in Vietnam against psychiatrist-administered structured clinical interviews and found to have acceptable internal consistency (Cronbach alpha of 0.88) and sensitivity of 79.1 % and specificity of 77.0 % [50]. It yields scores on depression, anxiety and stress subscales (range of each 0–21) and a total scale score (range 0–63). In the validation study, the total scale score was found to provide the best sensitivity and specificity and was recommended for use to detect common mental disorders among Vietnamese samples. For this study, only the total scale score was therefore used as an indicator of symptoms of mental health problems.

Suicidal thoughts and plans in the previous year were assessed using two fixed response yes/no questions adapted from the (YRBS) 2013 [47] which had been used in the national surveys of Vietnamese adolescents [39]: “During the past 12 months, did you ever seriously consider attempting suicide?” [47] and “During the past 12 months, did you make a plan about how you would attempt suicide?” [47].

Procedure

Study-specific questions and standardised measures which had not yet been validated in Vietnam were translated into Vietnamese by ML. The whole questionnaire was reviewed and revised by two public health researchers bilingual in Vietnamese and English, pre-tested and then pilot-tested among a small group of 17-year-old adolescents in Vietnam. Amendments, for example, that the term ‘private parts’ refers to the genitals and/or breasts, were made to maximise clarity of the questionnaire.

For the main survey, four to six classes were selected randomly at each school, and all students in the chosen classes were invited to participate. Participation was entirely voluntary. Participants completed the survey anonymously during a normal 45-min class session without any teacher or school staff present and returned the questionnaire, whether or not it had been completed, to the researchers in sealed envelopes.

Data management and analyses

Data were entered into a password-protected database developed in Epidata 3.1 [51]. STATA 14.0 was used for all data analyses [52].

Responses to each question in the JVQ R-2 and supplemental items were coded as yes (1) or no (0) and a total “poly-victimisation” score of the 37 items was calculated [44]. The total score (range 0–37) indicated the number of forms of victimisation, among the forms examined, each participant had experienced during their lifetime. Participants were categorised into three groups based on this score: non-victims (score of 0), victims (score of 1–10) and poly-victims (>10). The cut-off score of more than 10 was used to be consistent with a previously published paper from this dataset [31] and to allow comparison with findings from elsewhere [33].

In the first step, bivariate relationships between poly-victimisation and the total DASS-21-V score was examined using one way ANOVA tests; between poly-victimisation and involvement in health risk behaviours and past year suicidal thoughts and plans by Chi square tests. These analyses were conducted separately for female and male students.

In the next step, path analyses, using generalised structural equation modelling, were performed separately for girls and boys, to investigate the relationships between poly-victimisation and the outcomes while adjusting for socio-demographic characteristics (see Fig. 3). In these analyses, involvement in health risk behaviours, DASS-21-V total score and suicidal ideas were endogenous variables. Socio-demographic variables and poly-victimisation were exogenous. The total poly-victimisation score was used to represent poly-victimisation.

Since missing data are not accommodated in STATA 14.0 generalised structural equation models [52], the path analyses included only complete data. The significance level was set at an alpha of 0.05.

Results

None of the schools and centres refused the invitation to participate. Of the 1745 students who were eligible and invited to participate, 120 were absent on the day of the survey, seven refused to participate and two parents did not grant permission for their child’s participation. A total of 1616 students returned a completed questionnaire, yielding a recruitment fraction of 92.6 %. Ten were excluded due to a large number of unanswered questions (more than two thirds of the questionnaire), which resulted in a sample of 1606 participants. About 45 % (729/1599) of the sample were females; half (49 %, 789/1606) lived in a rural area and the majority (88 %, 1409/1596) lived with both parents.

Experiences of interpersonal violence victimisation were prevalent with more than 94 % of the participants reporting at least one form of victimisation during their lifetime and more than 31 % reported experiencing poly-victimisation, or more than 10 forms of victimisation [31]. Adolescents who suffered from a chronic disease or disability, lived with a step parent, lived in a rural area and who reported experiences of adverse events were among those most vulnerable to poly-victimisation (see [31] for a more detailed account of prevalence and socio-demographic correlates).

The percentages of girls, boys and the total sample of all students who reported health risk behaviours are shown in Table 1. Overall, tobacco smoking and drinking alcohol were the most common among the six health risk behaviours examined. Physical fighting was also prevalent with nearly one in five students reporting being involved in a physical fight in the previous 12 months. Boys were significantly more likely than girls to behave in these ways.

Table 1 Prevalence of involvement in health risk behaviours and previous year suicidal thoughts and plans among the study sample

Among female adolescents, compared to non-victims or victims of up to ten forms of violence, poly-victims were significantly more likely to be involved in almost all of these behaviours, except for having multiple sexual partners (see Fig. 1a) (p < 0.05 for all Chi square tests, except “multiple sexual partners”). Among male adolescents, poly-victims were significantly more likely to participate in all of these behaviours (see Fig. 1b; p < 0.05 for all Chi square tests).

Fig. 1
figure 1

a, b Percentages of girls and boys reporting different health risk behaviours by victimisation categories among a sample of 1606 Vietnamese high school students

Students in this sample had a DASS-21-V total mean score of 15.4 ± 11.2. Girls had significantly higher mean DASS-21-V total score (17.5 ± 10.9) compared to boys (13.7 ± 11.1).

For both girls and boys, there were significant associations between poly-victimisation and more symptoms of mental health problems. Male students who were poly-victimised had significantly higher DASS-21-V total mean scores (18.9 ± 11.5) compared to victims of up to 10 forms (12.0 ± 10.0) and non-victims (6.6 ± 8.8) (p < 0.001 in ANOVA analysis). Similarly, female students who were poly-victimised had significantly higher DASS-21-V total mean scores (22.5 ± 11.4), compared to victims of up to 10 forms (15.2 ± 9.4) and non-victims (11.1 ± 11.0) (p < 0.001 in ANOVA analysis).

Suicidal ideas were prevalent among these students with 14.1 % reported having suicidal thoughts and 5.7 % having made plans for committing suicide in the prior year (see Table 1). Girls were significantly more like to have suicidal thoughts or plans in the previous year, compared to boys. Similar to health risk behaviours and mental health problems, there was significant association between poly-victimisation and suicidal ideas in the past year. For both sexes, poly-victims were much more likely than non-victims or victims to report having suicidal thoughts and plans in the last 12 months (see Fig. 2a, b) (p < 0.05 for all Chi square tests).

Fig. 2
figure 2

a, b Percentages of girls and boys reporting suicidal ideas in the previous year by victimisation categories among a sample of 1606 Vietnamese high school students

Results from the path analyses are presented in Fig. 3. For simplicity, coefficients for the paths between all socio-demographic factors and involvement in health risk behaviours, mental health symptoms and suicidal ideas were omitted from the figure; the error term for the DASS-21-V total score was also omitted.

Fig. 3
figure 3

Path analysis of health risk behaviours, mental health problems, suicidal thoughts and plans: direct and indirect impacts of poly-victimisation among a sample of 1606 Vietnamese high school students. Coefficients are presented. Solid lines represent significant paths; dotted lines represent non-significant paths. Coefficients for the paths between socio-demographic variables and the three outcomes were omitted for simplicity. The error terms for the DASS-21-total score were also omitted

Overall, path analyses revealed that for both sexes, poly-victimisation was significantly associated with increased risk of involvement in health risk behaviours and more symptoms of mental health problems (higher DASS-21-V scores). For both girls and boys, poly-victimisation was indirectly associated with an increased risk of previous year suicidal ideas via mental health symptoms (see Fig. 3).

For female students, poly-victimisation was also indirectly associated with an increased risk of suicidal thoughts and plans via involvement in health risk behaviours. These indirect impacts indicated that female adolescents who were poly-victimised were more likely to be involved in health risk behaviours and to experience mental health symptoms, both of which then increased the students’ risk of having suicidal ideas in the previous year.

For male students, the indirect association between poly-victimisation and suicidal ideas via mental health problems indicated that boys who were poly-victimised were more likely to experience symptoms of anxiety, depression or stress, which then led to suicidal thoughts and plans.

For both sexes, there was no significant direct association between poly-victimisation and suicidal thoughts and plans. Adjusted odds ratios for the direct relationships between involvement in health risk behaviours, mental health problems and suicidal thoughts and plans are presented in Table 2. For health-risk behaviours, the adjusted odds ratio suggested that girls who performed any of these behaviours were nearly two times more likely to have suicidal thoughts and plans in the previous year, compared to those who did not. For mental health problems, the adjusted odds ratio suggested that for each additional point increase in the total DASS-21-V (out of 63), there was a 6 % increase in the odds of having suicidal ideas in the previous year among girls and a 9 % increase among boys.

Table 2 Adjusted odds ratios for direct relationships between involvement in health risk behaviours, mental health symptoms and previous year suicidal ideas among a sample of Vietnamese high school students (results from path analysis)

Discussion

This study is one of the very few studies from lower-middle income countries to examine the associations among poly-victimisation, health risk behaviours, mental health symptoms and suicidal thoughts and plans among adolescents and revealed that they are common and significantly related to each other.

This study was robust in including schools representing all main academic settings in Vietnam, having a high recruitment fraction, and using international standardised measures, which were formally validated and had strong psychometric properties. The use of generalised structural equation modelling allowed investigation of direct as well as indirect causal pathways between exposure to poly-victimisation and suicidal ideas. Nevertheless, we acknowledge some limitations that the schools were not randomly selected and the study was conducted in one city which might limit the generalisability of the results to high school students living in remote areas or who are out-of-school. The JVQ-R2 used to assess poly-victimisation had not undergone formal validation in Vietnam. However, extensive pre-test and pilot-test were conducted to ensure the acceptability, comprehensibility and suitability for use among Vietnamese adolescents. Information about frequency and severity of the violent experiences had not been sought. Nevertheless, previous research has shown that poly-victimisation, even when not taken into account frequency or severity, has a more detrimental impact on the victim’s mental health than chronic exposure to individual forms of victimisation [21]. There is also empirical evidence that taking into account the frequency of victimisation incidents and weighting the corresponding form of victimisation in the total number of victimisation experienced did not increase significantly the association between multiple victimisation and mental health outcomes [23]. Overall, we believe the results can be generalised with considerable confidence to adolescents attending high schools in Vietnam.

Poly-victimisation and adolescents’ involvement in health risk behaviours

An important finding of this study was the significant associations between poly-victimisation, and adolescents’ involvement in health risk behaviours among both girls and boys. Students who were poly-victimised were more likely to participating in health risk activities, including smoking, alcohol drinking, illegal drug use, involvement in physical fights, carrying a weapon and having multiple sexual partners. It appears that the experience of poly-victimisation increases the risk of smoking which shifts girls’ behaviour from the traditional norm of non-smoking among Vietnamese women; while for boys it shifts their behaviour towards the adult male Vietnamese norm of smoking. These results are consistent with those recorded previously [29]. Among 3155 Chinese adolescents aged 12–18 years, Dong et al. [29] found significant associations between poly-victimisation, alcohol drinking and use of pornography.

Poly-victimisation and mental health symptoms

Data from this study also reveal the apparent detrimental impacts of exposure to multiple forms of violence, crimes and abuse on adolescent mental health among both sexes in this setting. This is consistent with previous research among adolescents in Vietnam, which found that physical violence perpetrated either by a family member or a non-family-member is associated with increased risk of low mood and deliberate self-harm or suicidal behaviours [17]; and that there was a dose–response relationship between number of forms of child maltreatment and symptoms depression and anxiety and lower level of self-esteem [9]. These studies however investigated only limited forms of victimisation. It was extended in this study to include property victimisation, dating violence, peer or sibling victimisation, witnessing of domestic or community violence and Internet harassment. Overall 31.1 % (95 % CI 27.8–33.5 %) reported lifetime exposure to at least 10 forms of victimisation [43] and poly-victims had more symptoms of mental health problems.

This is similar to findings among adolescents in China [29], Finland [26], Spain [27] and the United States [11, 22]. Among Chinese adolescents, significant associations were found between poly-victimisation and symptoms of depression and anxiety [29]. Among Finnish 12–16 year-old adolescents, poly-victims were found to have increased levels of social behaviour problems, internalising as well as externalising symptoms compared to non-victims or victims of fewer forms [26].

Poly-victimisation and suicidal thoughts and plans

In this sample, both female and male students who were poly-victimised were more likely to report having had suicidal thoughts than non-victims or victims of fewer forms of victimisation (35 % versus 8 % and nearly 16 %, respectively, among girls; and 11 % versus 0 % and 7 %, respectively among boys). They were also more likely to report having made plans for suicide in the previous year than non-victims and victims of fewer forms of victimisation (12 % versus 4 % and 6 %, respectively, among girls; and 6 % versus 0 % and 3 %, respectively among boys). There appeared to be a strong association between poly-victimisation and suicidal ideation.

However, results in path analysis revealed that when other potential confounding factors were taken into account, including the presence of a chronic disease or disability, living with a step-parent, perceived quality of family relationship, rural/urban residence, and number of adverse life events experienced, the direct association between poly-victimisation and suicidal ideation among both sexes were no longer observable. This means that for both female and male poly-victims, apart from having been subjected to multiple forms of victimisation, they also experienced other risk factors, which may have made them more vulnerable to suicidal ideation.

For both sexes, poly-victims were more likely to be experiencing symptoms of mental health problems, which then increased risk of having suicidal ideas, including when potential confounding factors were controlled. This finding of an indirect relationship between experiences of poly-victimisation and suicidal ideas are consistent with previous research in high and upper-middle-income countries, which found significant associations between poly-victimisation and mental health [11, 21, 22, 35, 53], suicidal thoughts and deliberate self-harm [28, 34] among children and adolescents. Mental health has also been shown to mediate the impact between childhood adverse events, including exposure to violence and abuse, and suicidal ideas and behaviours among South African adolescents [54].

These results can be explained by the theoretical models for suicide, which propose that suicide is the result of a multifactorial pathway and experiences of humiliation and entrapment are “central risks” [55, 56]. In this study, adolescents who are poly-victimised may have felt humiliated, trapped and finding no way to escape from their circumstances of accrued violent victimisation. They may also experience mental health problems, including anxiety or depression. All of these may have led adolescents to suicidal ideation, which they consider a solution to their circumstances [16].

For female adolescents in this sample, poly-victimisation also had a significant association with increased risks of suicidal thoughts and plans via involvement in health risk behaviours. The mediating role of health risk behaviours, such as substance use, on the relationship between exposure to violence and suicidal behaviours has also been recorded among adolescents elsewhere [57]. It is suggested that “cognitive-behavioural theory” may be applied to explain this relationship [58, 59]. This theory posits that “predisposing vulnerabilities” such as exposure to child maltreatment, may result in “maladaptive cognitive, behavioural and emotional responses to acute stressors” among adolescents [59]. When an “acute stressor” occurs, adolescents may find themselves not being able to find appropriate “adaptive solutions”, which increase their levels of distress. They may respond to this in a “distorted manner” and choose to engage in health risk behaviours, such as alcohol or substance use, which worsen their distress. Adolescents may then think about suicide as a means to “escape from a perceived intolerable internal state and hopeless life situation” [59].

Prevalence of suicidal ideas in comparison with prior data from Vietnam and in other countries

Prevalence of past year suicidal thoughts in this sample (14.1 %) is higher than prevalence of lifetime suicidal thoughts or self-harm behaviours reported previously among nationally representative samples of adolescents in Vietnam [17] (5.3 % in SAVY 1 and 12.2 % in SAVY 2). This increasing trend in the prevalence of suicidal thoughts from 2004–05 to 2009–10 and 2013 might be because Vietnamese adolescents had improved emotional literacy during this period, which enabled them to recognise and name emotional states. It might also be that higher expectations from parents and teachers for academic success may result in a higher level of stress, and mental health problems and higher likelihood of adolescents having suicidal thoughts. More importantly, as demonstrated in this study, it might also be that adolescents were cumulatively exposed to more forms of victimisation, including child maltreatment, peer or sibling victimisation and the newly emerging forms of victimisation like cyber bullying, which increased their risks of having suicidal ideas.

When compared with results from other low- and lower-middle income countries, the prevalence of suicidal thoughts and plans in our sample is lower than those reported in some countries, but higher than in others. For example, it was reported that 16.3 % of the 13–15-year-old Filipino students who participated in the Global School-based Student Health Survey had seriously considered attempting suicide in the past 12 months, while these were lower for Sri Lanka (9.9 %), Indonesia (4.4 %), Cambodia (5.5 %) and Myanmar (0.7 %) [6063]. These differences suggest that country-specific characteristics beyond economic development may play an important role in adolescents’ suicidal thoughts and plans. Such characteristics may include adolescents’ risks of exposure to victimisation, as well as available policy, suicide prevention and mental health care programs in each country.

Gender differences in adolescents’ involvement in risky behaviours, mental health problems and suicidal thoughts and plans

This study replicated results reported previously in Vietnam [17, 40, 48, 64, 65] as well as in other countries [20, 66] about the significantly higher likelihood of boys to engage in externalising behaviours, including smoking, alcohol drinking, physical fighting, carrying a weapon or having multiple sexual partners, and of girls to have internalising problems, including depression and anxiety, or suicidal ideas. In fact, girls in this survey were nearly three times more likely to have suicidal thoughts and two times more likely to have suicidal plans in the previous year than boys (Table 1).

A higher risk of boys engaging in externalising behaviours than girls may be attributable to a higher likelihood of them being affected by peer pressure to be involved in behaviours not permitted by adults [48]; whereas the increased risk of suicidal ideation among girls indicated gender inequality in the Vietnamese society. Despite increased people’s awareness and the Vietnamese government’s effort in addressing this problem, including prohibition of sex-selective abortions and provision of equal opportunity for education for every child, preference towards a son remains in Vietnam, especially in rural areas [67, 68]. The country had a 2014 male:female sex ratio at birth of 112:100 [69]. This is because boys are believed to carry on the family name while girls do not, and sons are expected to care for their parents in old age [70]. At the family level, girls are also expected to do more household chores and they have less opportunities for education [71]. The mean years of schooling for Vietnamese girls are 7.0 while these are 7.9 for boys. At the community level, girls have less opportunities for employment: 82 % of males aged 15 and above participate in the workforce while only 73 % of females do [72]. In addition, Vietnamese girls have been shown to be more likely to experience neglect and emotional abuse than boys [9]. All of these factors may have resulted in a higher likelihood of symptoms of mental health problems and suicidal ideas among girls compared to boys in this setting.

Directions for future research and implications for practice and policy

This study provides important implications for research, policy and practice in Vietnam. Future research on exposure to violence among Vietnamese adolescents should not be limited to individual forms of violence. Further longitudinal investigations, taking into account frequency and intensity of the victimisation experiences, to facilitate improved understanding of suicidal behaviours among adolescents in Vietnam are needed. Such investigations will help provide a comprehensive evidence base to inform appropriate policies and the development of national programs for mental health care and suicide prevention of children and adolescents in Vietnam.

The Prime Minister of Vietnam’s Decision 1215/QD-TTg in 2011 marked a recent advance in recognition of the needs of people with severe psychotic disorders in the country. It aimed to encourage involvement of families and communities in providing support and functional rehabilitation for these patients and provide funding for different projects in 2011–20. However, the prevalence of non-psychotic mental health problems and suicidal ideation and behaviours remains less well recognised. There is no national program for the care of mental health, prevention of suicidal ideation or behaviours and prevention of violence among children and adolescents in Vietnam. It is clear from these data that such programs should focus on risk-factor reduction, in particular addressing gender inequality and reducing violence towards children and adolescents within families, schools and neighbourhoods as a crucial mechanism to prevent health risk behaviours and improve the mental health of Vietnamese young people.

Conclusion

Poly-victimisation is associated with involvement in health risk behaviours, poor mental health and increased likelihood of suicidal thoughts and plans among adolescents in Vietnam, but is yet to be recognised. In order to improve the mental health and full social and economic participation of young people, these data suggest that violent victimisation warrants an urgent national response.

Abbreviations

CI:

Confidence Interval

DASS-21:

Depression, Anxiety and Stress Scale-21

DASS-21-V:

Vietnamese validation of the Depression, Anxiety and Stress Scale-21

JVQ R-2:

Juvenile Victimisation Questionnaire Revised 2

SAVY:

Survey Assessment of Vietnamese Youth

YRBS:

Youth Risk Behaviours Survey

References

  1. The World Health Organisation: health for the world’s adolescents: A second chance in the second decade. Mortality, morbidity and disability in adolescence; 2014.

  2. Kieling C, Baker-Henningham H, Belfer M, Conti G, Ertem I, Omigbodun O, Rohde LA, Srinath S, Ulkuer N, Rahman A. Child and adolescent mental health worldwide: evidence for action. Lancet. 2011;378(9801):1515–25.

    Article  PubMed  Google Scholar 

  3. Belfer ML. Child and adolescent mental disorders: the magnitude of the problem across the globe. J Child Psychol Psychiatry. 2008;49(3):226–36.

    Article  PubMed  Google Scholar 

  4. World Health Organisation. Global health estimates 2013 summary tables: DALYs, YLLs and YLDs by cause, age and sex by WHO regional group and World Bank income classification, 2012 (provisional estimates). Geneva: World Health Organisation; 2014.

    Google Scholar 

  5. Health for the world’s adolescents: a second chance in the second decade. Mortality in adolescents by WHO Regions 2000 & 2012 aged 10 to 19 years [http://public.tableausoftware.com/profile/digitalteam#!/vizhome/shared/3JW3RBSZ3].

  6. Turner H, Butler M. Direct and indirect effects of childhood adversity on depressive symptoms in young adults. J Youth Adolesc. 2003;32(2):89–103.

    Article  Google Scholar 

  7. Amato PR, Cheadle JE. Parental divorce, marital conflict and children’s behavior problems: a comparison of adopted and biological children. Soc Forces. 2008;86(3):1139–61.

    Article  Google Scholar 

  8. Amato PR, Keith B. Parental divorce and the well-being of children—a meta analysis. Psychol Bull. 1991;110(1):26–46.

    Article  CAS  PubMed  Google Scholar 

  9. Nguyen HT, Dunne MP, Le AV. Multiple types of child maltreatment and adolescent mental health in Vietnam.[Erratum appears in Bull World Health Organ. 2010 Mar; 88(3):236]. Bull World Health Organ. 2010;88(1):22–30.

    Article  PubMed  Google Scholar 

  10. Fleming LC, Jacobsen KH. Bullying among middle-school students in low and middle income countries. Health Promot Int. 2010;25(1):73–84.

    Article  PubMed  Google Scholar 

  11. Turner H, Shattuck A, Hamby S, Finkelhor D. Community disorder, victimization exposure, and mental health in a national sample of youth. J Health Soc Behav. 2013;54(2):258–75.

    Article  PubMed  Google Scholar 

  12. Jia ZB, Shi LZ, Duan GF, Liu WZ, Pan X, Chen YY, Tian WH: Traumatic experiences and mental health consequences among child survivors of the. Sichuan earthquake: a community-based follow-up study. BMC Public Health. 2008;2013:13.

    Google Scholar 

  13. Mels C, Derluyn I, Broekaert E, Rosseel Y. The psychological impact of forced displacement and related risk factors on Eastern Congolese adolescents affected by war. J Child Psychol Psychiatry. 2010;51(10):1096–104.

    Article  PubMed  Google Scholar 

  14. Betancourt TS. The impact of war on child development and mental health: a longitudinal study of risk and resilience among former child soldiers in Sierra Leone. In: Patel, Deepali M, editors. 2012. p. 88–97.

  15. Benjet C. Childhood adversities of populations living in low-income countries: prevalence, characteristics, and mental health consequences. Curr Opin Psychiatry. 2010;23(4):356–62.

    Article  PubMed  Google Scholar 

  16. Fisher J, de Cabral de Mello M, Izutsu T, Vijayakumar L, Belfer M, Omigbodun O. Adolescent mental health in resource-constrained settings: a review of the evidence of the nature, prevalence and determinants of common mental health problems and their management in primary health care. Int J Soc Psychiatry. 2011;57:9–116.

    Article  Google Scholar 

  17. Le MT, Nguyen HT, Tran TD, Fisher JR. Experience of low mood and suicidal behaviors among adolescents in Vietnam: findings from two national population-based surveys. J Adolesc Health. 2012;51(4):339–48.

    Article  PubMed  Google Scholar 

  18. Walsh K, Latzman NE, Latzman RD. Pathway from child sexual and physical abuse to risky sex among emerging adults: the role of trauma-related intrusions and alcohol problems. J Adolesc Health. 2014;54(4):442–8.

    Article  PubMed  Google Scholar 

  19. Agardh A, Tumwine G, Asamoah BO, Cantor-Graae E. The invisible suffering: sexual coercion, interpersonal violence, and mental health—a cross-sectional study among university students in south-western Uganda. PLoS ONE. 2012;7(12):e51424.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  20. Brown DW, Riley L, Butchart A, Meddings DR, Kann L, Harvey AP. Exposure to physical and sexual violence and adverse health behaviours in African children: results from the Global School-based Student Health Survey. Bull World Health Organ. 2009;87(6):447–55.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Finkelhor D, Ormrod R, Turner H. Poly-victimization: a neglected component in child victimization. Child Abuse Negl. 2007;31(1):7–26.

    Article  PubMed  Google Scholar 

  22. Turner H, Finkelhor D, Ormrod R. The effect of lifetime victimization on the mental health of children and adolescents. Soc Sci Med. 2006;62(1):13–27.

    Article  PubMed  Google Scholar 

  23. Finkelhor D, Hamby SL, Ormrod R, Turner H. The juvenile victimization questionnaire: reliability, validity, and national norms. Child Abuse Negl. 2005;29(4):383–412.

    Article  PubMed  Google Scholar 

  24. Finkelhor D, Ormrod R, Turner H, Hamby SL. The victimization of children and youth: a comprehensive, national survey. Child Maltreat. 2005;10(1):5–25.

    Article  PubMed  Google Scholar 

  25. Finkelhor D, Ormrod R, Turner H, Hamby S. Measuring poly-victimization using the juvenile victimization questionnaire. Child Abuse Negl. 2005;29(11):1297–312.

    Article  PubMed  Google Scholar 

  26. Ellonen N, Salmi V. Poly-victimization as a life condition: correlates of poly-victimization among Finnish children. J Scand Stud Criminol Crime Prev. 2011;12(1):20–44.

    Article  Google Scholar 

  27. Soler L, Kirchner T, Paretilla C, Forns M. Impact of poly-victimization on mental health: the mediator and/or moderator role of self-esteem. J Interpers Violence. 2013;28(13):2695–712.

    Article  PubMed  Google Scholar 

  28. Chan KL. Victimization and poly-victimization among school-aged Chinese adolescents: prevalence and associations with health. Prev Med. 2013;56(3–4):207–10.

    Article  PubMed  Google Scholar 

  29. Dong F, Cao F, Cheng P, Cui N, Li Y. Prevalence and associated factors of poly-victimization in Chinese adolescents. Scand J Psychol. 2013;54(5):415–22.

    Article  PubMed  Google Scholar 

  30. Bashir Z, Dasti R. Poly-victimization and mental health of street children in Lahore city. J Ment Health. 2015;24(5):305–12.

    Article  PubMed  Google Scholar 

  31. Le MTH, Holton S, Nguyen HT, Wolfe R, Fisher J. Poly-victimisation among Vietnamese High School students: prevalence and demographic correlates. PLoS ONE. 2015;10(5):e0125189.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Finkelhor D, Ormrod R, Turner H. Lifetime assessment of poly-victimization in a national sample of children and youth. Child Abuse Negl. 2009;33(7):403–11.

    Article  PubMed  Google Scholar 

  33. Turner H, Finkelhor D, Ormrod R. Poly-victimization in a national sample of children and youth. Am J Prev Med. 2010;38(3):323–30.

    Article  PubMed  Google Scholar 

  34. Soler L, Segura A, Kirchner T, Forns M. Polyvictimization and risk for suicidal phenomena in a community sample of Spanish adolescents. Violence Vict. 2013;28(5):899–912.

    Article  PubMed  Google Scholar 

  35. Finkelhor D, Ormrod R, Turner H. Poly victimization and trauma in a national longitudinal cohort. Dev Psychopathol. 2007;19(01):149–66.

    Article  PubMed  Google Scholar 

  36. Al-Fayez GA, Ohaeri JU, Gado OM. Prevalence of physical, psychological, and sexual abuse among a nationwide sample of Arab high school students: association with family characteristics, anxiety, depression, self-esteem, and quality of life. Soc Psychiatry Psychiatr Epidemiol. 2012;47(1):53–66.

    Article  PubMed  Google Scholar 

  37. Le MT, Holton S, Romero L, Fisher J. Poly-victimisation among children and adolescents in low and lower-middle income countries: a systematic review and meta-analysis. Trauma, violence and abuse. 2016.

  38. The General Statistics Office of Vietnam: The Vietnam population and housing census. Age-sex structure and marital status of the population in Vietnam. Hanoi. 2009;2011:168.

    Google Scholar 

  39. The General Statistics Office of Vietnam: survey assessment of Vietnamese youth 2. Hanoi; 2011.

  40. Phuong TB, Huong NT, Tien TQ, Chi HK, Dunne MP. Factors associated with health risk behavior among school children in urban Vietnam. Global Health Action. 2013;6:1–9.

    Article  PubMed  Google Scholar 

  41. Le LC, Blum RW. Intentional injury in young people in Vietnam: prevalence and social correlates. MEDICC review. 2011;13(3):23–8.

    Article  PubMed  Google Scholar 

  42. Le MTH, Tran TD, Nguyen HT, Fisher J. Early marriage and intimate partner violence among adolescents and young adults in Vietnam. J Interpers Violence. 2014;29(5):889–910.

    Article  Google Scholar 

  43. Le MTH, Holton S, Nguyen HT, Wolfe R, Fisher J: Poly-victimisation among Vietnamese high school students: prevalence and demographic correlates. Plos ONE. 2015.

  44. The Juvenile Victimization Questionnaire toolkit [http://www.unh.edu/ccrc/jvq/index_new.html].

  45. Finkelhor D, Ormrod R, Turner H, Holt M. Pathways to poly-victimization. Child Maltreat. 2009;14(4):316–29.

    Article  PubMed  Google Scholar 

  46. Finkelhor D, Turner H, Ormrod R, Hamby S. Trends in childhood violence and abuse exposure: evidence from 2 national surveys. Arch Pediatr Adolesc Med. 2010;164(3):238–42.

    Article  PubMed  Google Scholar 

  47. Centers for Disease Control and Prevention. 2013. State and local youth risk behaviour survey [http://www.cdc.gov/healthyyouth/yrbs/pdf/questionnaire/2013_hs_questionnaire.pdf].

  48. Nguyen HT. Child maltreatment in Vietnam: prevalence and associated mental and physical health problems. Thesis for the degree of doctor of philosophy. Queensland University of Technology, Faculty of Health; 2006.

  49. Lovibond SH, Lovibond PF. Manual for the Depression Anxiety Stress Scale. 2nd ed. Sydney: Psychology Foundation; 1995.

    Google Scholar 

  50. Tran TD, Tran T, Fisher J. Validation of the depression anxiety stress scales (DASS) 21 as a screening instrument for depression and anxiety in a rural community-based cohort of northern Vietnamese women. Bmc Psychiatry. 2013;13:24.

    Article  PubMed  PubMed Central  Google Scholar 

  51. Lauritsen JM, Bruus M: Epidata 3.1. A comprehensive tool for validated entry and documentation of data. Odense, Denmark: The EpiData Association; 2003–05.

  52. Statacorp: Stata statistical software: Release 14. College Station: Statacorp LP; 2015.

  53. Price-Robertson R, Higgins DJ, Vassallo S. Multi-type maltreatment and polyvictimisation: a comparison of two research frameworks. Family Matters. 2013;93:84–98.

    Google Scholar 

  54. Cluver L, Orkin M, Boyes ME, Sherr L. Child and adolescent suicide attempts, suicidal behavior, and adverse childhood experiences in South Africa: a prospective study. J Adolesc Health. 2015;57(1):52–9.

    Article  PubMed  Google Scholar 

  55. Fisher J. Perinatal psychiatric care needs of women who die by suicide. Lancet Psychiatry. 2016;3(3):191–2.

    Article  PubMed  Google Scholar 

  56. O’Connor R. Towards an integrated motivational-volitional model of suicidal behaviour. In: O’Connor RC, Platt S, Gordon J, editors. International handbook of suicide prevention: research, policy & practice. Chichester: Wiley; 2011.

    Chapter  Google Scholar 

  57. Litwiller BJ, Brausch AM. Cyber bullying and physical bullying in adolescent suicide: the role of violent behavior and substance use. J Youth Adoles. 2013;42(5):675–84.

    Article  Google Scholar 

  58. Spirito A, Esposito-Smythers C, Weismoore J, Miller A. Child and adolescent therapy: Cognitive-behavioral procedures. Adolescent suicidal behavior. 4th ed. New York: Guilford Press; 2012. p. 234–56.

    Google Scholar 

  59. Miller AB, Esposito-Smythers C. How do cognitive distortions and substance related problems affect the relationship between child maltreatment and adolescent suicidal ideation? Psychol Violence. 2013;3(4):340–53.

    Article  PubMed  PubMed Central  Google Scholar 

  60. World Health Organisation: Global school-based student health survey: Indonesia 2007 fact sheet. 2007.

  61. World Health Organisation: Global school-based student health survey: Myanmar 2007 fact sheet. 2007.

  62. World Health Organisation: Global school-based student health survey: Cambodia 2013 fact sheet. 2013.

  63. World Health Organisation: Global school-based student health survey: Sri-Lanka 2008 fact sheet. 2008.

  64. Kaljee LM, Green M, Riel R, Lerdboon P, Tho LH, Thoa LTK, Minh TT. Sexual stigma, sexual behaviors, and abstinence among Vietnamese adolescents: implications for risk and protective behaviors for HIV, sexually transmitted infections, and unwanted pregnancy. J Assoc Nurse Aids C. 2007;18(2):48–59.

    Article  Google Scholar 

  65. Kaljee LM, Green MS, Zhan M, Riel R, Lerdboon P, Lostutter TW, Van Luong V, Tho LH, Minh TT. Gender, alcohol consumption patterns, and engagement in sexually intimate behaviors among adolescents and young adults in Nha Trang, VietNam. Youth Soc. 2011;43(1):118–41.

    Article  PubMed  PubMed Central  Google Scholar 

  66. Kann L, McManus T, Harris WA, Shanklin SL, Flint KH, Hawkins J, Queen B, Lowry R, Olsen EOM, Chyen D, et al. Youth risk behavior surveillance–United States, 2015. MMWR Surveill Summ. 2016;65((SS-6)):1–174.

    Google Scholar 

  67. Guilmoto CZ. Son preference, sex selection, and kinship in Vietnam. Popul Develop Rev. 2012;38(1):31–54.

    Article  Google Scholar 

  68. Belanger D, Oanh KTH. Second-trimester abortions and sex-selection of children in Hanoi, Vietnam. Pop Stud J Demog. 2009;63(2):163–71.

    Article  Google Scholar 

  69. Sex ratio at birth by region [https://www.gso.gov.vn/default_en.aspx?tabid=774].

  70. Belanger D. Son preference in a rural village in North Vietnam. Stud Fam Plann. 2002;33(4):321–34.

    Article  PubMed  Google Scholar 

  71. Nguyen T, Chang PPW, Loh JMI. The psychology of Vietnamese tiger mothers: qualitative insights into the parenting beliefs and practices of Vietnamese-Australian mothers. J Family Stud. 2014;20(1):48–65.

    Article  Google Scholar 

  72. United Nations Development Programme: human development report 2015: Work for human development. The United States: United Nations Development Programme; 2015. p. 288.

Download references

Authors’ contributions

All authors contributed to the conceptualisation and design of the study and the survey. ML and HTN conducted the field work. ML performed data entry and data management. ML, SH, RW and JF analysed the data. ML prepared the first draft. All authors contributed to the revision of the manuscript and agreed on the final draft. All authors read and approved the final manuscript.

Acknowledgements

We thank all participating schools, centres and students for their support and enthusiastic participation. We are also grateful for the helpful review and enormous contribution of Mrs. Hau Nguyen and Dr. Thach Tran in the translation of the JVQ R2. We thank all staff at the Jean Hailes Research Unit, Monash University for the comments on the questionnaire and earlier drafts of this paper.

Competing interests

The authors declare that they have no competing interests.

Availability of data and materials

The dataset analysed during the current study is available from the corresponding author on reasonable request.

Ethics approval and Consent to participate

The ethical principles for the study were to ensure informed voluntary participation, protection of privacy and prevention of harm. The World Health Organisation recommends that investigations of experiences of violence, including those that might be occurring at home, should regard adolescents aged at least 12–3 years as “mature minors”, who are able, with sufficient information, to make informed decisions in their own interest. Reflecting this, and usual research practice in Vietnam, an opt-out consent process was used. All parents were informed about the study in advance and had the opportunity not to permit their child to participate. All eligible students were also given detailed information about the study in advance of the survey and were informed in writing and orally that they had the right not to participate. The students completed an anonymous survey and their informed consent was implied in the decision to complete the questionnaire.

The study received ethics approval from the Monash University Human Research Ethics Committee (Project no: CF13/1762-2013000897) and the Institutional Review Board of the Hanoi School of Public Health (Project no: Application number 013-148/DD-YTCC). All participating schools gave formal permission for the study to be conducted.

Funding

JF is supported by a Monash Professorial Fellowship and the Jean Hailes Professorial Fellowship which is funded by the L and H Hecht Trust managed by Perpetual Trustees Pty Ltd. ML was supported by a Monash International Postgraduate Research Scholarship and a Monash Graduate Scholarship funded by Monash University; and a 2013 International Student Scholarship funded by Graduate Women Victoria. The funders had no role in study design, data collection, data analyses, interpretation of the results, preparation of the manuscript and the decision to submit the paper for publication.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Minh T. H. Le.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Le, M.T.H., Holton, S., Nguyen, H.T. et al. Poly-victimisation and health risk behaviours, symptoms of mental health problems and suicidal thoughts and plans among adolescents in Vietnam. Int J Ment Health Syst 10, 66 (2016). https://doi.org/10.1186/s13033-016-0099-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13033-016-0099-x

Keywords