Skip to main content
Download PDF
Download ePub

Development of the Mental Health Peer Support Questionnaire in colleges and vocational schools in Singapore

International Journal of Mental Health Systems volume 16, Article number: 45 (2022) Cite this article

Abstract

Background

A nation-wide mental health peer support initiative was established in college and vocational schools in Singapore. The purpose of this cross-sectional study was to develop and validate a 20-item self-report instrument, the Mental Health Peer Support Questionnaire (MHPSQ), to assess young adults’ perceived knowledge and skills in mental health peer support.

Methods

We administered the questionnaire to 102 students who were trained as peer supporters, and 306 students who were not trained as peer supporters (denoted as non-peer supporters), in five college and vocational schools. Exploratory factor analysis and descriptive statistics were conducted. Cronbach’s α was used to assess reliability, and independent sample t-tests to assess criterion validity.

Results

Exploratory factor analysis indicated a three-factor structure with adequate internal reliability (discerning stigma [α = .76], personal mastery [α = .77], skills in handling challenging interpersonal situations [α = .74]; overall scale [α = .74]). Consistent with establishing criterion validity, peer supporters rated themselves as significantly more knowledgeable and skilled than non-peer supporters on all items except two: (1) letting peer support recipients make their own mental health decisions, and (2) young adults’ self-awareness of feeling overwhelmed. Peer supporters who had served the role for a longer period of time had significantly higher perceived awareness of stigma affecting mental health help-seeking. Peer supporters who had reached out to more peer support recipients reported significantly higher perceived skills in handling challenging interpersonal situations, particularly in encouraging professional help-seeking and identifying warning signs of suicide.

Conclusions

The MHPSQ may be a useful tool for obtaining a baseline assessment of young adults’ perceived knowledge and skills in mental health peer support, prior to them being trained as peer supporters. This could facilitate tailoring of training programs based on young adults’ initial understanding of mental health peer support. Subsequent to young adults’ training and application of skills, the MHPSQ could also be applied to evaluate the effectiveness of peer programs and mental health training.

Background

Mental illness is a growing public health concern, with roughly half of all lifetime mental disorders starting by the mid-teens and three-quarters by the mid-20s [24]. Young adults living with serious and distressing mental health problems may refuse to seek help or considerably delay seeking professional mental health services [7, 18], due to concerns such as stigma, embarrassment and confidentiality [19]. This may lead to adverse health outcomes, including substance abuse, risky sexual behavior, lower quality of adult life and premature death [3, 10, 11, 26]). More concerted efforts have to be conducted to improve the mental health well-being and help-seeking behaviors of young adults.

Peer support is an intervention that could benefit young adults facing emotional and mental health distress. Within the context of a school setting, peer support is defined as a process of assistance whereby trained, supervised students help other students with personal and school-related problems, offer supportive relationships, clarify peer support recipients’ (denoted as recipients) thoughts and feelings, explore options and help recipients in determining their own solutions [32]. In various countries, peer support programs have been extensively used to supplement traditional approaches to help college and vocational students, such as school counseling services [22]. Training and supervising young adults to reach their peers with health-related information have long been used to promote help-seeking behaviors [6].

In Singapore, young adults have the highest 12-month and lifetime prevalence of mental illness, as compared to older age groups [43]. A nation-wide survey found that only 6% of the population and 32% of those with depressive and anxiety disorders sought professional help for mental and emotional problems [33]. In 2016, an inter-governmental agency taskforce was formed in Singapore, charged to enhance young adults’ mental health. As part of this initiative, concerted efforts have been made to strengthen peer support networks for young adults in colleges and vocational schools throughout the country. This initiative requires all colleges and vocational schools in the country to set up a peer support program. Within each school, some of the students served as peer supporters and some were students who were not part of the peer support program (denoted as non-peer supporters). All schools provide training for peer supporters on topics such as mental health awareness, listening skills, and referring other students to professional resources, to help these students take on the role [29].

Despite the extensive literature on peer support programs for individuals with serious mental illness, few studies have investigated peer support programs for mental health promotion in colleges and vocational schools. Most studies on school-based mental health peer support were conducted in secondary or high schools [1, 13, 15, 20, 21, 38, 41] and one was conducted in a veterinary school [40]. Out of the four studies found that were conducted among college students, two had small sample sizes of 20 to 30 peer supporters [2, 4], one collected only qualitative data [4], and two did not collect any primary data [22, 42]. Only two studies on school-based programs were found to have collected data from recipients of these peer programs [1, 40]. One review was available regarding a peer program in the Asian context, but it did not involve any data collection [22]. No studies thus far have assessed the knowledge and skills of mental health peer support among young adults in Asia.

The purpose of this study was to develop and validate the Mental Health Peer Support Questionnaire (MHPSQ), an instrument intended to assess perceived mental health peer support knowledge and skills among young adults in college and vocational schools with peer support programs. We provide an exploratory factor analysis (EFA) on the underlying structure of the measured mental health peer support variables, and initial evidence of validity and reliability of the MHPSQ for potential use in other school-based peer support training programs.

As a check of criterion validity, we analyzed the responses from both peer supporters and non-peer supporters. We took into consideration whether participants had been trained to provide mental health peer support, and if they were, their self-reported peer support experiences. We hypothesized that participants who were trained to be peer supporters would have higher perceived knowledge of and skills in mental health peer support, relative to those who were not trained. A second hypothesis was that among peer supporters, having more experience in the role would be associated with greater perceived knowledge of and skills in mental health peer support.

The validated instrument could be used to obtain a baseline assessment of young adults’ understanding of mental health peer support prior to being trained, to facilitate the tailoring of peer support training programs. The instrument may also be used for the evaluation of peer support programs’ effectiveness subsequent to peer supporters’ training and practice.

Methods

Study sample

The collaborating institution partnering the schools to develop peer support programs, the Health Promotion Board Singapore, contacted eight colleges and vocational schools in Singapore that had an existing peer support program. Five of the eight schools agreed to participate in the study. To maintain confidentiality of the schools, the schools will be denoted in the order of how long their peer support program had been established, ranging from S1 (longest established program) to S5 (most recently established program).

Participating schools sent emails which contained a brief description of the study and links to the online surveys, to both peer supporters and non-peer supporters. Research team members also recruited additional non-peer supporters from public spaces (e.g., hallways, cafeterias, study rooms) of the five participating schools to invite them to participate in the online survey. Informed consent was obtained through the online survey platform, Qualtrics, before participants could proceed to complete the online surveys. Towels or stress balls were given as tokens of appreciation to participants who indicated interest in participating in the online survey. At the end of the study, each participating school received a report of their own schools’ data and students’ feedback on their program. The project was reviewed and approved by the Institutional Review Board of the Johns Hopkins University Bloomberg School of Public Health.

Study procedures

The online survey for peer supporters, administered through Qualtrics, included questions about basic demographics, the participants’ level of experience in the peer support role and the MHPSQ. For non-peer supporters, the survey included questions about basic demographics and the MHPSQ.

Measurement development

Mental Health Peer Support Questionnaire (MHPSQ)

As majority of the participating schools used the peer supporter training workshops provided by the Health Promotion Board, we referred to the training content of these peer supporter training workshops to identify major topics that peer supporter trainings had in common. Peer supporter training provided by all schools included content reflecting five common training topics: (1) fundamental skills of peer support, (2) self-care, (3) understanding mental health, (4) identifying distress in peers, and (5) promoting help-seeking behavior. A pool of items was generated that assessed perceived knowledge and skills under each of the common training topics.

We sought assistance from five consultants in the Health Promotion Board who were in charge of designing the program and collaborating with the schools. This was to ensure that the topics identified and the MHPSQ items generated were coordinated with what was taught to peer supporters in training programs throughout all the participating schools. We circulated drafts of the instrument to the consultants for comments in an iterative manner. Feedback was incorporated into final versions of the questionnaire, which enabled us to arrive at a smaller number of items. We also edited the item wording to better fit the students’ language and mental health literacy levels. The final version of the MHPSQ included 20 items. Responses to each item were evaluated on a six-point rating scale ranging from “Strongly disagree” (coded 1) to “Strongly agree” (coded 6). A six-point scale was used to avoid neutral responses while capturing more granular differences in rating.

Participant characteristics

The online surveys for both peer supporters and non-peer supporters gathered information on sociodemographic characteristics, such as age (in years), gender (male, female), self-identified race (Chinese, Malay, Indian, Caucasian, Other), school and graduation year (2019, 2020, 2021, 2022, Other). Age was recoded as a categorical variable due to small numbers in higher ages. Graduation year and school information were used to calculate the number of years students had spent in their school. Peer supporters were also asked questions to assess their level of experience as a peer supporter: (1) when they attended training workshop(s) to become a peer supporter (one-month intervals from < 1 month ago to > 12 months ago), (2) the number of recipients they had supported since their first training (None, 1 to 5, 6 to 10, 11 to 15, 16 to 20, > 20), (3) the number of recipients they recommended to seek professional help (None, 1 to 5, 6 to 10, 11 to 15, 16 to 20, > 20), and (4) the number of recipients who had sought professional help, among those whom the peer supporters had recommended to seek help (None, 1 to 5, 6 to 10, 11 to 15, 16 to 20, > 20, Don’t know).

Analytic strategy

To assess validity and reliability of the MHPSQ, our data analysis proceeded in six phases. First, data were inspected for errors and outliers and cleaned as needed. Only participants who completed all 20 items of the instrument were retained in subsequent analyses. Second, exploratory factor analysis (EFA) for all items on the scale were carried out to identify underlying relations between measured mental health peer support variables. The EFA sample size meets the general guidelines of N = 200 and at least ten participants per indicator [31, 34]. Scree plots, eigenvalues and parallel analysis based on the 20 MHPSQ items were used to determine the number of factors to retain. Two eigenvalues were greater than 1, three eigenvalues were greater than 0.70. Scree plots suggested two factors while parallel analysis suggested three factors. We explored the possibility of two or three correlated factors accounting for the data. Maximum likelihood procedures were employed and all solutions were rotated obliquely using oblimin rotation [23]. Maximum likelihood allows for the computation of a wide range of goodness of fit indices, factor correlations and confidence interval computations [16]. Oblimin rotation is preferable when underlying factors could be correlated [36]. Pattern matrices were analyzed using 0.32 as the cutoff value for a salient factor loading, which corresponds to a minimum 10% overlap in variance with other items in the same factor [44]. Crossloading items that loaded at 0.32 or higher on more than one factor were dropped from the analysis. Third, in conducting descriptive data analyses, we investigated the distributional properties of each demographic (for both peer supporters and non-peer supporters) and experience (only for peer supporters) variable. Pearson’s chi-square [35] was used to identify any possible trend among responses that were missing or incomplete. Fourth, we computed Cronbach’s alpha coefficients [12] for the subscales. Fifth, we sorted the peer supporter sample into two reference groups based on when they had been trained, as a proxy for how long they had been active peer supporters in the program: above the median (more than eight months ago) and at or below the median (eight months or less). To assess criterion validity, we compared peer supporters above the median duration as active peer supporters to those below the median, based on individual items and total scores of the MHPSQ factors. We also sorted the peer supporter sample into two reference groups based on how many recipients they had supported since their first training: above the median (six or more recipients) and at or below the median (fewer than six recipients). We then conducted comparisons on individual items and total scores of the MHPSQ factors. We hypothesized that among peer supporters, having more experience in the role would be associated with higher perceived mental health knowledge and peer support skills. Sixth, to further assess criterion validity, we compared peer supporters with non-peer supporters, based on individual items and total scores of the MHPSQ factors. We also hypothesized that participants who were trained to be peer supporters would have greater perceived knowledge of and skills in mental health peer support, relative to those who were not trained. We used independent sample t-tests [25] to compare item and total factor mean scores between high and low experience groups and between peer supporters and non-peer supporters, with an α of 0.05 for statistical significance. All analyses were conducted with the R statistical program, version 3.5.1 [37].

Results

Sample characteristics

Of 148 peer supporters who started the peer supporter questionnaire, 102 completed all items on the MHPSQ (68.9% completion rate). There was no particular point in the questionnaire where attrition occurred. When demographic and experience covariates were examined, peer supporters who completed the MHPSQ (n = 101) and those who did not complete the MHPSQ (n = 14) were significantly different in terms of gender (χ2 (1, n = 115) = 4.57, p < 0.05) and race (χ2 (3, n = 115) = 9.42, p < 0.05). Fewer males and Indians completed the MHPSQ.

Of 536 non-peer supporters who started the non-peer supporter questionnaire, 306 completed all items of the MHPSQ (57.1% completion rate). There was also no particular point in the questionnaire where attrition occurred. No statistically significant demographic differences were found between non-peer supporters who completed the MHPSQ (n = 263) and those who did not complete the MHPSQ (n = 24), except for the school they were enrolled in (χ2 (4, n = 287) = 9.60, p < 0.05). S1 and S4 had fewer non-peer supporters completing the MHPSQ.

The peer supporter and non-peer supporter questionnaires took an average of 15.2 and 15.6 min to complete, respectively. This calculation excluded durations that exceeded 5.5 h, as those participants were likely to not have completed the survey at one sitting.

Table 1 shows the demographics of the analytic sample, the 102 peer supporters and 306 non-peer supporters who completed the MHPSQ. The mean ages of peer supporters and non-peer supporters were 20.6 years (SD = 2.61) and 20.7 years (SD = 2.55) respectively. The mean amounts of time peer supporters and non-peer supporters had been enrolled in their school were 1.34 years (SD = 1.26) and 1.13 years (SD = 1.30) respectively. Approximately 74.2% of Singapore’s population is ethnically Chinese [39], thus there was a slight overrepresentation of Chinese in our peer supporter sample (81.2%). More females participated in the peer supporter survey than males.

Table 1 Demographics of peer supporters and non-peer supporters, Singapore 2018
Full size table

Factor analysis

The three-factor solution (GFI = 0.92, AGFI = 0.87, RMSR = 0.03, RMSEA = 0.04, CFI = 0.97) had better model fit than the two-factor solution (GFI = 0.81, AGFI = 0.76, RMSR = 0.06, RMSEA = 0.07, CFI = 0.87). Further comparisons with alternative models are shown in the Additional file 1.

The three-factor solution with 16 items was used for subsequent analyses. The first factor represented items associated with discerning stereotypes and prejudices (denoted as Discerning Stigma) (1) “Young people with mental illness are dangerous;” (2) “People with mental illness can just get over their emotional problems if they try;” (3) “Serious mental health problems are obvious;” (4) “Stigma does not affect people’s willingness to seek help.” The second factor consisted of eight items related to personal mastery in one’s peer support abilities and judgment (Personal Mastery): (1) “Self-care is important;” (2) “Mental health stigma can be caused by media portrayals;” (3) “I am able to understand my peers with empathy;” (4) “I can talk about ways of coping with my peers;” (5) “I am confident of letting my peers make their own decisions about their mental health;” (6) “I am aware of when I am feeling overwhelmed;” (7) “I know the differences between self-harm and suicide;” (8) “I am able to encourage my peers to have positive mental health.” The third factor was associated with skills in handling challenging interpersonal situations (Interpersonal Skills): (1) “I find it difficult to encourage my peers to seek professional help when they need it;” (2) “I find it hard to tell my peers concerns in a non-judgmental way;” (3) “I tend to focus on myself in conversations with my peers, even when I don't mean to;” (4) “I find it difficult to identify warning signs of suicide.”

The three-factor model showed good fit (GFI = 0.92, AGFI = 0.87, RMSR = 0.03, RMSEA = 0.04, CFI = 0.97), acceptable internal reliability (α = 0.74) and cumulatively explained 36.9% of the variance. Factor loadings of the items, eigenvalues, percent of total variance explained and scale reliability values (Cronbach’s α coefficient) for each of the three factors are shown in Table 2. Factor correlations indicated divergent validity (correlation between Discerning Stigma and Personal Mastery = 0.06; correlation between Discerning Stigma and Interpersonal Skills = 0.50; correlation between Personal Mastery and Interpersonal Skills = 0.02).

Table 2 Summary of exploratory factor analysis results for the Mental Health Peer Support Questionnaire (MHPSQ), Singapore 2018
Full size table

Criterion validity

Comparison among peer supporters, by experience with peer support

Mean ratings for each item and total factor scores were calculated and compared between peer supporters that reported having been active peer supporters for a period above the sample median (calculated based on when they were trained; median = 8 months), and those that were at or below the median. For the Discerning Stigma factor, the reverse-coded item “Stigma does not affect people’s willingness to seek help” (M = 0.58, 95% CI = [0.04, 1.12], p < 0.05) was significantly higher for peer supporters who reported having been active for a longer period of time. There were no statistically significant differences in total factor and item scores for the Personal Mastery and Interpersonal Skills factors.

The same comparison was conducted between peer supporters that reported having supported a number of recipients above the sample median (one to five recipients), and those who supported a number of recipients at or below the median. There were no statistically significant differences in total factor and item scores for Discerning Stigma and Personal Mastery factors. For the Interpersonal Skills factor, the reverse-coded items “I find it difficult to encourage my peers to seek professional help when they need it” (M = 0.70, 95% CI = [0.18, 1.22], p < 0.01) and “I find it difficult to identify warning signs of suicide” (M = 0.56, 95% CI = [0.06, 1.03], p < 0.05) were significantly higher for peer supporters who reported having supported more recipients. The total score for Interpersonal Skills was also significantly higher (M = 1.67, 95% CI = [0.09, 3.25], p < 0.05) for peer supporters who reported having supported more recipients.

Comparison between peer supporters and non-peer supporters

We calculated and compared each item and total factor scores between peer supporters and non-peer supporters (Table 3). Peer supporters had significantly higher mean ratings of total factor and all item scores for all three factors, except for the items “I am confident of letting my peers make their own decisions about their mental health” and “I am aware of when I am feeling overwhelmed” in the Personal Mastery factor.

Table 3 Results of T-Test and descriptive statistics comparing peer supporters and non-peer supporters for the Mental Health Peer Support Questionnaire (MHPSQ), Singapore 2018
Full size table

Discussion

Overview

The purpose of this study was to develop and validate an instrument for measuring the perceived knowledge of and skills in mental health peer support among young adults in colleges and vocational schools in Singapore. In the current study, EFA was used to identify underlying relations among measured variables on mental health peer support. EFA uncovered three domains: discerning stereotypes and prejudices (Discerning Stigma), personal mastery in one’s abilities and judgment (Personal Mastery), and skills in handling challenging interpersonal situations (Interpersonal Skills). These three domains differed from the original five training topics that were used to guide the instrument design, suggesting that the latent constructs for mental health peer support centered around young adults’ perception of relative ease and challenges in applying mental health support to self and others in practice, and not how the training content was organized by consultants. Each of three identified factors had high internal reliability and criterion validity. As part of establishing criterion validity, our study also compared peer supporters across experience levels, and peer supporters to non-peer supporters. We hypothesized that peer supporters with more experience would have more perceived mental health knowledge and peer support skills than peer supporters with less experience, and that peer supporters would have more perceived knowledge and skills than non-peer supporters.

Criterion validity

Relation between being a peer supporter and perceived mental health peer support knowledge and skills

Our study found that peer supporters, as compared to non-peer supporters, were significantly more likely to have higher perceived ability to discern stigma, higher perceived mastery of peer support abilities and judgment, and higher perceived skills in handling challenging interpersonal situations. These findings reveal robust criterion validity between being a peer supporter and almost all aspects of perceived peer support knowledge and skills, as all items were significantly different between peer supporters and non-peer supporters, except perceived confidence in letting peers make their own mental health decisions and perceived awareness of feeling overwhelmed. This could possibly be due to deficits in those specific areas of training or those concepts being more resistant to change through training. In other words, despite having received training on respecting their recipients’ mental health decisions, peer supporters could still believe that it would be better for their recipients’ long-term wellbeing if their recipients were more strongly encouraged to seek professional mental health help. Young adults may also either not require training to know when they are feeling burnt out, or the training was not effective in improving this skill. Those who were selected or volunteered to be peer supporters could also be better at self-care, thus less likely to feel overwhelmed regardless of training.

These results suggest that young adults’ perceived mental health knowledge and peer support skills were positively associated with experience as a peer supporter. Strong self-efficacy has been demonstrated to motivate and sustain one’s endeavors for optimal performance, increasing one’s attention and efforts to situational demands and resilience in the face of obstacles [5]. Our results suggest that peer supporter trainings could build young adults’ self-efficacy through increasing perceived knowledge and skills on specific domains covered in the MHPSQ, thus possibly increasing their motivations to be a positive pillar of support for their peers. In the peer support literature, studies found that training programs increased peer supporters’ recognition of suicide symptoms [21] and decreased their stigmatizing beliefs [20]. Peer support training also had positive impacts on general communication skills [40, 41] and specific empathetic and reflection skills [2, 9, 28]. Peer supporters had also reported self-development [40], increased confidence in supporting peers [15, 20], decreased nervousness and increased self-awareness [1]. A longitudinal study on secondary school peer supporters’ pre- and post-peer program participation found significant improvement in peer support skills and understanding [15], which corroborates the results from our study. These findings suggest that school-based programs that involve young adults in mental health training and supporting their peers could be an effective way to increase young adults’ perceived mental health literacy and skills to cope with their own and their peers’ mental health issues.

Relation between peer support experience and perceived mental health peer support knowledge and skills

We also found that young adults who had been peer supporters for a longer period of time were significantly more likely to recognize that stigma could affect one’s willingness to seek help, than those who had been peer supporters for a shorter duration. Peer supporters who had supported more peers reported significantly higher perceived confidence in encouraging their peers to seek professional help when necessary, in identifying warning signs of suicide, and in handling challenging interpersonal situations as a whole. These self-rated results indicate criterion validity between peer supporter experience and several components of perceived peer support knowledge and skills.

Supporting more recipients was associated with significantly increased perceived skills in handling a variety of challenging interpersonal situations, while being peer supporters for a longer period of time was not significantly associated with increased perceived skills. Therefore, these results suggest that the practical application of peer support skills through interaction with recipients is more strongly associated with increased perceived ability in handling challenges, relative to merely having been in the peer support program for a longer period of time. The findings also suggest that years of experience and real-life application of peer support skills might be more salient than the initial training in improving perceived knowledge and skills. This suggests that conducting ongoing trainings and sharing expertise among peer supporters could be beneficial program components that would facilitate knowledge and skill transfers.

Study limitations

Before discussing the implications of our results, the limitations of our study should be considered. First, we were not able to collect longitudinal data comparing peer supporters pre- and post-training and after a follow-up period. Therefore, we were unable to determine that the peer support training and/or program had a causal effect on improving perceived mental health knowledge and skills. Nevertheless, we had a comparison group of students who did not participate in the peer support program, which allowed us to examine the validity of our instrument and the effectiveness of these programs. We also made an initial assessment of criterion validity by comparing self-ratings among peer supporters based on their experience level, and we found that peer supporters with more experience reported higher self-ratings in perceived knowledge and skills. Further studies should be conducted to determine whether the peer support training and/or experience improved students’ mental health knowledge and skills, or students with higher perceived knowledge and skills were more likely to volunteer or be nominated to join peer support programs. Future studies can administer our instrument to peer supporters pre- and post-training and at follow-up, to investigate whether peer support training or experience plays a larger role in improving perceived mental health knowledge and skills. Second, sample size limitations precluded our ability to conduct confirmatory factor analysis (CFA) to further verify the factor structure uncovered by EFA. A goal of future research would be to apply the instrument to a separate sample to test the extent the proposed factor structure could be replicated. Other knowledge and skill measures can also be applied to examine convergent validity of the instrument. Third, the assessment of perceived peer support knowledge and skills was based on self-reports, and young adults’ actual peer support practices could not be objectively verified. While the present measures are able to assess the self-efficacy young adults bring to the peer support role, future research can supplement self-ratings with observational studies or school counsellors’ assessment of young adults’ mental health knowledge and peer support skills. Third, despite our sample size being larger than most existing studies on peer support, the current study only involved colleges and vocational schools in Singapore. Thus, our results might not be generalizable to different cultures and education systems, and the assessment instrument should be tested with other samples. School-based peer support programs for young adults deserve attention because of the limited literature available on this topic, especially among countries in Asia. Our results from the Singapore context offer a unique perspective bridging Western and Eastern cultures, as Singapore’s culture and education system have been largely influenced by both the East and the West. This could facilitate the adaptability of this questionnaire to schools in other countries.

Implications

The implications of school-based peer support research for public mental health are timely. Critiques of peer support programs have been centered on the program development and implementation procedures, and the program evaluation research methods. Major critiques of these programs highlighted problems in providing adequate peer supporter training and supervision, and underlined challenges in defining and limiting peer supporter roles [8, 14, 17, 27, 30, 32]. Main criticisms of research evaluating these programs had centered around the predominant use of qualitative methods, where conclusions were mainly based on subjective comments and difficult to replicate [14, 30, 41]. The success of peer support programs and peer supporters is largely contingent on peer supporters’ skill development through training and experience in the programs. However, very little in the way of quantitatively assessing peer support programs has been reported, and there is a need for an instrument can serve as a guide for peer supporter training and program evaluation. Our study offers a validated self-assessment instrument, the MHPSQ, that can be administered alongside peer support training to measure young adults’ mental health understanding and peer support skills. The MHPSQ may be used to quantitatively assess peer supporter training and young adults’ skill development with increasing peer support experience. In the case of program development, the instrument could be used to assess peer supporters’ baseline perceived mental health knowledge and skills, and to guide and tailor training programs based on peer supporters’ self-identified needs.

Conclusions

Based on our sample, we have developed an instrument measuring core components of peer support programs, with demonstrated reliability and validity in a nation-wide peer support initiative. The availability of the MHPSQ as a brief assessment tool can facilitate the design and evaluation of school-based mental health peer support programs. A goal of future research would be to use CFA and qualitative methods to refine the instrument items, to further validate and improve the tool across various implementation contexts.

Availability of data and materials

The datasets analysed during this study are available from the corresponding author on reasonable request.

Abbreviations

MHPSQ:

Mental Health Peer Support Questionnaire

EFA:

Exploratory factor analysis

CFA:

Confirmatory factor analysis

References

  1. Abu-Rasain MHM, Williams DI. Peer counselling in Saudi Arabia. J Adolesc. 1999;22(4):493–502. https://doi.org/10.1006/jado.1999.0243.

    Article  CAS  PubMed  Google Scholar 

  2. Aladag M, Tezer E. Effects of a peer helping training program on helping skills and self-growth of peer helpers. Hague. 2009. https://doi.org/10.1007/s10447-009-9082-4.

    Article  Google Scholar 

  3. Anderson JE, Lowen CA. Connecting youth with health services: Systematic review. Can Fam Physician. 2010;56:778–84.

    PubMed  PubMed Central  Google Scholar 

  4. Badura AS, Millard M, Johnson C, Stewart A,  Bartolomei S. Positive outcomes of volunteering as a peer educator: A qualitative study (Report No. CG 032-187). Creighton University. (ERIC Document Reproduction Service No. ED 473426). Retrieved from EBSCOHost ERIC database. 2003

  5. Bandura A. Self-efficacy mechanism in human agency. Am Psychol. 1982;37(2):122–47. https://doi.org/10.1037/0003-066X.37.2.122.

    Article  Google Scholar 

  6. Barker G. Adolescents, social support and help-seeking behaviour: an international literature review and programme consultation with recommendations for action. Geneva: World Health Organization; 2007.

    Google Scholar 

  7. Biddle L, Donovan JL, Gunnell D, Sharp D. Young adults’ perceptions of GPs as a help source for mental distress: a qualitative study. Br J Gen Pract. 2006;56(533):924–31.

    PubMed  PubMed Central  Google Scholar 

  8. Black DR, Tobler NS, Sciacca JP. Peer helping/involvement: an efficacious way to meet the challenge of reducing alcohol, tobacco, and other drug use among youth? J Sch Health. 1998. https://doi.org/10.1111/j.1746-1561.1998.tb03488.x.

    Article  PubMed  Google Scholar 

  9.  Brenton, Kelly Lynn . Report of a counselling internship at Eugene Vaters Academy and Junior High, St. John's, Newfoundland, including a research project: implementation and evaluation of the effectiveness of a peer helping training program at the Junior High. Masters thesis, Memorial University of Newfoundland, 1999

  10. Brindis C, Hair E, Cochran S, Cleveland K, Valderrama L, Park M. Increasing access to program information: A strategy for improving adolescent health. Matern Child Health J. 2007;11(1):27–35. https://doi.org/10.1007/s10995-006-0143-6.

    Article  PubMed  Google Scholar 

  11. Brindis C, Park MJ, Ozer EM, Irwin J, Charles E. Adolescents’ access to health services and clinical preventive health care: Crossing the great divide. Pediatr Ann. 2002;31(9):575–81. https://doi.org/10.3928/0090-4481-20020901-10.

    Article  PubMed  Google Scholar 

  12. Cronbach LJ. Coefficient alpha and the internal structure of tests. Psychometrika. 1951;16:297–334.

    Article  Google Scholar 

  13. Diver-Stamnes AC. Assessing the effectiveness of an inner-city high school peer counseling program. Urban Educ. 1991;26(3):269–84. https://doi.org/10.1177/0042085991026003002.

    Article  Google Scholar 

  14. Downe AG, Altmann HA, Nysetvold I. Peer counseling: More on an emerging strategy. Sch Couns. 1986;33(5):355–64.

    Google Scholar 

  15. Eisenstein C, Zamperoni V, Humphrey N, Deighton J, Wolpert M, Rosan C, et al. Evaluating the peer education project in secondary schools. J Public Ment Health. 2019. https://doi.org/10.1108/JPMH-07-2018-0048.

    Article  Google Scholar 

  16. Fabrigar LR, Wegener DT, MacCallum RC, Strahan EJ. Evaluating the use of exploratory factor analysis in psychological research. Psychol Methods. 1999;4(3):272–99. https://doi.org/10.1037/1082-989X.4.3.272.

    Article  Google Scholar 

  17. Fennell R. A review of evaluations of peer education programs. J Am Coll Health. 1993. https://doi.org/10.1080/07448481.1993.9936336.

    Article  PubMed  Google Scholar 

  18. Goodman R, Ford T, Meltzer H. Mental health problems of children in the community: 18 month follow up. BMJ. 2002;324(7352):1496–7. https://doi.org/10.1136/bmj.324.7352.1496.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Gulliver A, Griffiths KM, Christensen H. Perceived barriers and facilitators to mental health help-seeking in young people: a systematic review. BMC Psychiatry. 2010;10(1):113. https://doi.org/10.1186/1471-244X-10-113.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Hart LM, Morgan AJ, Rossetto A, Kelly CM, Mackinnon A, Jorm AF. Helping adolescents to better support their peers with a mental health problem: a cluster-randomised crossover trial of teen mental health first aid. Aust N Z J Psychiatry. 2018;52(7):638–51. https://doi.org/10.1177/0004867417753552.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Hennig CW, Crabtree CR, Baum D. Mental health CPR: Peer contracting as a response to potential suicide in adolescents. Arch Suicide Res. 1998;4(2):169–87. https://doi.org/10.1080/13811119808260446.

    Article  Google Scholar 

  22. Hsi T, Chung YLA. Peer helpers: Bridging the gap between the student community and the university’s counseling service. Paper presented at the 12th Asia--Pacific Student Services Association Conference 2010. 2010.

  23. Jackson JE. Oblimin rotation. In: Armitage P, Colton T, editors. Encyclopedia of biostatistics. Chichester: John Wiley and Sons Ltd.; 2005. p. 3800.

    Google Scholar 

  24. Kessler R, Amminger G, Aguilar-Gaxiola S, Alonso J, Lee S, Üstün T. Age of onset of mental disorders: a review of recent literature. Curr Opin Psychiatry. 2007;20(4):359–64. https://doi.org/10.1097/YCO.0b013e32816ebc8c.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Kim TK. T test as a parametric statistic. Korean J Anesthesiol. 2015;68(6):540–6. https://doi.org/10.4097/kjae.2015.68.6.540.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Laski L. Realising the health and wellbeing of adolescents. BMJ. 2015. https://doi.org/10.1136/bmj.h4119.

    Article  PubMed  Google Scholar 

  27. Lewis MW, Lewis AC. Peer helping programs: helper role, supervisor training, and suicidal behavior. J Couns Dev. 1996;74(3):307–13. https://doi.org/10.1002/j.1556-6676.1996.tb01871.x.

    Article  Google Scholar 

  28. Martin AA, II. The effectiveness of Christian adolescent peer counselor training: a controlled study. Available from ProQuest Dissertations & Theses Full text: the humanities and social sciences collection. 1998.

  29. Ministry of Health Singapore, Ministry of Education Singapore. NurtureSG action plan report. Singapore: Ministry of Health Singapore & Ministry of Education Singapore; 2016.

    Google Scholar 

  30. Morey RE, Miller CD, Rosén LA, Fulton R. High school peer counseling: the relationship between student satisfaction and peer counselors’ style of helping. Sch Couns. 1993;40(4):293–300.

    Google Scholar 

  31. Myers ND, Ahn S, Jin Y. Sample size and power estimates for a confirmatory factor analytic model in exercise and sport: a Monte Carlo approach. Res Q Exerc Sport. 2011;82(3):412–23. https://doi.org/10.1080/02701367.2011.10599773.

    Article  PubMed  Google Scholar 

  32. Myrick RD, Folk BE. The power of peervention: a manual for the trainers of peer facilitators. Minneapolis: Educational Media Corporation; 1999.

    Google Scholar 

  33. Ng TP, Jin AZ, Ho R, Chua HC, Fones CSL, Lim L. Health beliefs and help seeking for depressive and anxiety disorders among urban Singaporean adults. Psychiatr Serv. 2008;59(1):105–8. https://doi.org/10.1176/appi.ps.59.1.105.

    Article  PubMed  Google Scholar 

  34. Norman GR, Streiner DL. Biostatistics: the bare essentials. 4th ed. Shelton: PMPH USA; 2014.

    Google Scholar 

  35. Pearson K. On the criterion that a given system of deviations from the probable in the case of a correlated system of variables is such that it can be reasonably supposed to have arisen from random sampling. Philos Mag Series. 1990;50(302):157–75.

    Article  Google Scholar 

  36. Pett MA, Lackey NR, Sullivan JJ. Making sense of factor analysis: the use of factor analysis for instrument development in health care research. Los Angeles: SAGE Publications Inc.; 2003.

    Book  Google Scholar 

  37. R CoreTeam. R: A language and environment for statistical computing. Vienna: R Foundation for Statistical Computing; 2018.

    Google Scholar 

  38. Robinson SE, Morrow S, Kigin T, Lindeman M. Peer counselors in a high school setting: Evaluation of training and impact on students. Sch Couns. 1991;39(1):35–40.

    Google Scholar 

  39. Singapore population. 2018. http://worldpopulationreview.com/countries/singapore-population/. Accessed 13 Dec 2018.

  40. Spielman S, Hughes K, Rhind S. Development, evaluation, and evolution of a peer support program in veterinary medical education. J Vet Med Educ. 2015;42(3):176–83. https://doi.org/10.3138/jvme.1114-115R.

    Article  PubMed  Google Scholar 

  41. Steinbauer L. The effects of a high school peer counselor training program on the self-appraisal skills and the interpersonal skills of the trained peer leader. ProQuest Dissertations & Theses Full text: the humanities and social sciences collection. 1998.

  42. Stokes DR, Gonzales M, Rowe D, Romero D, Adams M, Lyons S, Rayfield GE. Multicultural peer counseling: a developmental perspective and rationale. J Couns Dev. 1988;67(1):55–6. https://doi.org/10.1002/j.1556-6676.1988.tb02012.x.

    Article  Google Scholar 

  43. Subramaniam M, Abdin E, Vaingankar JA, Shafie S, Chua BY, Sambasivam R, et al. Tracking the mental health of a nation: prevalence and correlates of mental disorders in the second Singapore Mental Health Study. Epidemiol Psychiatr Sci. 2019. https://doi.org/10.1017/S2045796019000179.

    Article  PubMed  PubMed Central  Google Scholar 

  44. Tabachnick BG, Fidell LS. Using multivariate statistics. Boston: Allyn and Bacon; 2001.

    Google Scholar 

Download references

Acknowledgements

We would like to acknowledge the support from the Health Promotion Board, Singapore for contacting schools, reviewing the study materials and providing tokens of appreciation. We would also like to acknowledge the participating schools and the school counselors for helping to coordinate the data collection.

Funding

This research did not receive grant funding from agencies in the public, commercial, or not-for-profit sectors.

Author information

Authors and Affiliations

  1. Department of Mental Health, Johns Hopkins University Bloomberg School of Public Health, 624 North Broadway Street, 8Th Floor, Baltimore, MD, 21205, USA

    QianHui Ma

  2. Department of Mental Health, Johns Hopkins University Bloomberg School of Public Health, 624 North Broadway Street, Baltimore, MD, 21205, USA

    Joseph J. Gallo

  3. Department of Mental Health, Johns Hopkins University Bloomberg School of Public Health, 624. North Broadway Street, Baltimore, MD, 21205, USA

    Jeanine M. Parisi

  4. Department of Psychiatry and Behavioral Sciences, Johns Hopkins University School of Medicine, Johns Hopkins Bayview Medical Center, 5300 Alpha Commons Dr, Baltimore, MD, 21224, USA

    Jin Hui Joo

Authors
  1. QianHui Ma
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Joseph J. Gallo
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jeanine M. Parisi
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jin Hui Joo
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

QM was involved in (1) the conception and design of the study, obtaining IRB approval, acquisition of data, and analysis and interpretation of data, (2) drafting the article and revising it critically for important intellectual content, (3) final approval of the version to be submitted. JG and JJ were involved in the analysis and interpretation of data, revision and final approval. JP was involved in obtaining IRB approval, revision and final approval. All authors read and approved the final manuscript.

Corresponding author

Correspondence to QianHui Ma.

Ethics declarations

Ethics approval and consent to participate

The project was reviewed and approved by the Institutional Review Board of the Johns Hopkins University Bloomberg School of Public Health. Informed consent was obtained through the online survey platform, Qualtrics, before participants could proceed to complete the online surveys.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1.

EFA model comparison statistics.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ma, Q., Gallo, J.J., Parisi, J.M. et al. Development of the Mental Health Peer Support Questionnaire in colleges and vocational schools in Singapore. Int J Ment Health Syst 16, 45 (2022). https://doi.org/10.1186/s13033-022-00555-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13033-022-00555-6

Keywords

International Journal of Mental Health Systems

ISSN: 1752-4458