Skip to main content
Download PDF
Download ePub

Whose responsibility? Part 1 of 2: A scale to assess how stakeholders apportion responsibilities for addressing the needs of persons with mental health problems

International Journal of Mental Health Systems volume 16, Article number: 1 (2022) Cite this article

Abstract

Background

Individuals with mental health problems have multiple, often inadequately met needs. Responsibility for meeting these needs frequently falls to patients, their families/caregivers, and governments. Little is known about stakeholders' views of who should be responsible for these needs and there are no measures to assess this construct. This study’s objectives were to present the newly designed Whose Responsibility Scale (WRS), which assesses how stakeholders apportion responsibility to persons with mental health problems, their families, and the government for addressing various needs of persons with mental health problems, and to report its psychometric properties.

Methods

The 22-item WRS asks respondents to assign relative responsibility to the government versus persons with mental health problems, government versus families, and families versus persons with mental health problems for seven support needs. The items were modelled on a World Values Survey item comparing the government’s and people’s responsibility for ensuring that everyone is provided for. We administered English, Tamil, and French versions to 57 patients, 60 family members, and 27 clinicians at two early psychosis programs in Chennai, India, and Montreal, Canada, evaluating test–retest reliability, internal consistency, and ease of use. Internal consistency estimates were also calculated for confirmatory purposes with the larger samples from the main comparative study.

Results

Test–retest reliability (intra-class correlation coefficients) generally ranged from excellent to fair across stakeholders (patients, families, and clinicians), settings (Montreal and Chennai), and languages (English, French, and Tamil). In the standardization and larger confirmatory samples, internal consistency estimates (Cronbach’s alphas) ranged from acceptable to excellent. The WRS scored average on ease of comprehension and completion. Scores were spread across the 1–10 range, suggesting that the scale captured variations in views on how responsibility for meeting needs should be distributed. On select items, scores at one end of the scale were never endorsed, but these reflected expected views about specific needs (e.g., Chennai patients never endorsed patients as being substantially more responsible for housing needs than families).

Conclusions

The WRS is a promising measure for use across geo-cultural contexts to inform mental health policies, and to foster dialogue and accountability among stakeholders about roles and responsibilities. It can help researchers study stakeholders’ views about responsibilities, and how these shape and are shaped by sociocultural contexts and mental healthcare systems.

Background

Persons with mental health problems have multiple support needs which are often inadequately met [1, 2]. Their needs tend to pertain to areas such as housing, employment, education, treatment, and emotional and financial support [1, 2]. Responsibility for meeting these needs is generally assumed by a variety of stakeholders, particularly patients, their families or caregivers, and governments. While services and treatment providers also play a role in mental health needs provision, it falls often to patients and families to access services and to cover their costs fully or partially, depending on the nature of the healthcare system. Moreover, in all countries, governmental policy and funding decisions shape the larger context of needs provision, i.e., how mental health services are funded, organized, and provided. Despite this landscape, little is known about how various stakeholders think about responsibility for fulfilling these support needs, including how they believe such responsibility should be apportioned.

Globally, there is a great discrepancy between countries in terms of government support for treatment, housing, employment, education, and income for persons with mental disorders [3, 4]. Ninety-six percent of high-income countries (HICs) report availability of such support compared with only 14% of low- and middle-income countries (LMICs) [5]. Even within HIC and LMIC groups, there is wide variation in the amount of coverage provided by governments [6,7,8].

Historically, there has been relatively little user input into the structure, functioning, orientation or even the outcomes judged to be salient in mental health services. With the extensive endorsement of recovery-oriented frameworks of mental health services, particularly in HICs [9,10,11], patients have a greater say in defining their own recovery, and what role they themselves want to play in it.

Across contexts, families are also known to play critical roles in caregiving and supporting recovery, especially for serious mental illnesses such as psychosis [12,13,14,15]. In some LMICs, families have always contributed to addressing various needs of persons with mental health problems, given prevailing cultural norms [16, 17] and the paucity of formal mental health resources [18]. Cultural norms and ideologies related to autonomy [19], family piety [20] and notions of duty [21] also dictate when individuals assume responsibility for their health, and when family or government involvement is expected. Family caregivers' evolving expectations of their mentally ill relative over time [22] also may shift their views of their responsibilities as compared to the responsibilities of other stakeholders.

A better understanding of the extent to which various stakeholders perceive one another as being responsible for providing for the needs of persons with mental illnesses would help clarify how mental healthcare structures and sociocultural contexts shape and are shaped by expectations in this regard [23]. Perceived roles and responsibilities have considerable implications for mental health policies, funding decisions, and the design of mental health services [24], which are currently undergoing substantial reform globally through the growing early intervention and integrated youth mental health movements [25,26,27]. Furthermore, on a day-to-day basis, each stakeholder’s perception of their own and others’ roles and responsibilities is also likely to affect the amount and type of support they actually extend.

In the context of our longitudinal comparative study of 2-year prospective outcomes of first-episode psychosis in India and Canada [28, 29], focus groups were conducted with patients, families, and clinicians, revealing differences in perceived stakeholder responsibilities across the two settings and between stakeholder groups. These varying perspectives on responsibility may contribute to differential outcomes across sociocultural settings.

Furthering our knowledge obtained through these qualitative studies requires a quantitative measurement of stakeholders’ relative attributions of responsibility to governments, families, and patients for addressing various needs of individuals with mental health problems in different settings. Currently, there are no measures available to achieve this objective. Thus, our aims in this two-part report are to present a newly designed measure, the Whose Responsibility Scale (WRS), a 22-item instrument in which patients, family members, and clinicians assign relative responsibility to persons with mental health problems, families, and the government for various aspects of the treatment/recovery of persons with mental health problems (Part 1, current paper), and to discuss findings from our larger study utilizing the WRS to examine differences between stakeholders in Chennai, India and Montreal, Canada in their attributions of responsibility to persons with mental health problems, families, and the government (Part 2). In this paper, we describe the WRS and detail its development and psychometric properties.

Methods

Research context

As part of a larger cross-cultural investigation of first-episode psychosis [28, 29], this study was carried out with patients, families, and clinicians at two early intervention programs for youth with psychosis in Montreal, Canada and Chennai, India. Participants in Chennai were recruited from the first-episode psychosis clinic of the Schizophrenia Research Foundation (SCARF), a not-for-profit, non-governmental mental health organisation. In Montreal, participants were recruited from two nodes of McGill University’s publicly funded Prevention and Early Intervention Program for Psychosis (PEPP) [30]. The Chennai and Montreal programs are open to referrals from a wide variety of sources and offer a similar protocol of intensive, phase-specific, two-year psychosocial (assertive case management, family interventions, family psychoeducation, therapy, etc.) and medical (flexible use of low-dose antipsychotic medication) treatments provided by a multidisciplinary team of clinicians (case managers and psychiatrists) to persons with first-episode psychosis [29]. Persons treated with antipsychotic medication for more than 30 days or with IQ below 70, solely substance-induced or organic psychosis, pervasive developmental disorder, or epilepsy are excluded from each program. Concurrent substance use is not an exclusion criterion.

The study was approved by the relevant institutional ethics boards in Montreal and Chennai, and all participants gave informed consent. In the case of individuals younger than 18 years, participants provided assent and their parents/guardians provided consent.

Participants

The standardisation sample comprised of 57 patients, 60 family members, and 27 clinicians across study sites (Table 1). Patients were included if they had a first episode of either affective or non-affective psychosis as determined by the Structured Clinical Interview for DSM IV-TR for Axis I Disorders (SCID-IV; [31]), were between 16–35 years old, and were fluent in English or French in Montreal, and English or Tamil in Chennai. The exclusion criteria were the same as that for the PEPP and SCARF programs. Family members were parents, spouses/partners, or siblings of patients with first-episode psychosis, and clinicians were case managers, psychiatrists, and other allied healthcare professionals (e.g., employment support specialists, psychologists, etc.) providing treatment at PEPP and SCARF.

Table 1 Sample characteristics
Full size table

Whose responsibility scale (WRS): development and description

The WRS was developed with multiple rounds of iterative discussion, feedback, and modifications involving clinician-scientists and mental health professionals at both sites with extensive experience in providing mental health care, including for persons with psychosis.

The WRS (Additional file 1) was modelled after an item that has been part of various rounds of the World Values Survey [32]. The item is rated on a 10-point scale, where 1 indicates complete agreement with the statement on the left pole of the scale (“The government should take more responsibility to ensure that everyone is provided for”), 10 indicates complete agreement with the statement on the right pole of the scale (“People should take more responsibility to provide for themselves”), and selection of any other number in between these poles reflects one’s relative weighting of the responsibility of each party. We included this item in the WRS, followed by a set of 21 similarly worded and structured items organized around seven needs of individuals with mental health problems: (1) general financial support, (2) housing support, (3) help with return to school/work, (4) help covering the costs of mental health services, (5) medication, (6) substance use treatment programs, and (7) mental health awareness-building and stigma reduction. These seven needs were selected based on previous literature [1, 33,34,35,36,37,38,39]; our clinical and program development experience; and focus group discussions on responsibilities of various stakeholders for supporting people with mental health problems, conducted with patients, families, and clinicians at PEPP and SCARF [40,41,42]. An initial version of the scale was also shared with three patients and two family members and their feedback was used to refine the scale and its instructions.

For each of these seven needs, a set of three items each rated on a 10-point scale are presented, with the first requiring respondents to contrast the role of the government with the role of persons with mental health problems, the second contrasting the role of the government with the role of families of persons with mental health problems, and the third contrasting the role of families with the role of persons with mental health problems (see Additional file 1). Respondents are asked to consider the attribution of responsibilities for supporting persons with mental health problems generally, and not with respect to their own specific case. In total, 22 items were included in the WRS.

The WRS was translated from English into Tamil and French and back-translated using standardized procedures recommended by the World Health Organization [43]. The WRS can be completed as a self-report or can be interviewer-administered.

WRS scoring

The first item of the WRS (taken directly from the World Values Survey [32]) is a stand-alone item and does not contribute to the scoring of the WRS, insofar as it does not specifically tap into any of the seven need areas that subsequent questions are organized around. However, it was included in the scale as a useful indicator of respondents' general views of individual versus governmental responsibility for need provision, and scores on this item can be compared to scores on the more specific questions to determine whether respondents' general views of locus of responsibility differ from their views of locus of responsibility for specific areas of support. The remaining 21 items can be scored to arrive at three composite scores reflecting the extent of responsibility attributed to (1) governments versus persons with mental health problems, (2) governments versus families, and (3) families versus persons with mental health problems for addressing all needs taken together.

To arrive at these three composite scores, all items comparing government and patient responsibilities are summed to derive the first composite score; all items comparing government and family responsibilities are summed to derive the second composite score; and all items comparing patient and family responsibilities are summed to derive the third composite score. Alternatively, scores on each individual item can be summed and then averaged across participants to arrive at more easily interpretable scores between 1 and 10.

Depending on the research or policy objectives, one may in some cases need to estimate attributions of responsibility regarding specific needs. If so, similar composite scores can also be derived for each of the seven needs separately (e.g., if one is particularly interested in perceptions of responsibility for housing support, the three items corresponding to this need can be summed and averaged in the same way across participants).

Procedure

To establish its psychometric properties, the WRS was administered as a self-report by trained research assistants to all participants (patients, families, and clinicians), in English or Tamil in Chennai and English or French in Montreal depending on participants’ linguistic preference, at two time points approximately two weeks apart in order to establish its test–retest reliability. Trained research staff were available to answer questions if needed and to administer a feedback questionnaire to a subset of the participants. We examined the internal consistency of the WRS using data obtained from the first administration of the measure. Internal consistency estimates were calculated for each set of seven items that were summed to derive responsibilities attributed to government versus persons with mental health problems, government versus families, and families versus persons with mental health problems. The internal consistency of the WRS was confirmed using the larger patient and family samples from the main comparative study (see Part 2 of this 2-part series).

We also examined the frequency distributions of WRS scores to see if respondents used all or part of the possible range (1–10) of item scores, by looking at whether there were scores between 1–3, 4–6, and 7–10 for each item.

To assess the scale's acceptability, we created a brief, easy-to-understand feedback questionnaire. This questionnaire includes two items that ask participants to rate the ease of comprehension and completion of the WRS on a 10-point Likert-type scale (1 = very difficult to 10 = very easy), and a third categorically-rated item (Was the WRS measure difficult to answer? – Yes/Somewhat/No). A subset of patients was approached to complete the feedback questionnaire (4–5 patients in each language, English and French in Montreal and English and Tamil in Chennai).

Data analyses

Data were analysed using IBM SPSS version 22. Descriptive data regarding the sample characteristics were represented as means, standard deviations (SDs), and percentages. The samples from the two sites were compared using independent samples t-tests or chi square tests, using 0.05 as the significance level. Test–retest reliability for patient, family, and clinician groups were computed separately using intra-class correlation coefficient (ICC), with a two-way random effects model of variance and absolute agreement between scores at the two time points (ICC2, 1) and single measure estimates [44] with a 95% confidence interval. The ICCs were interpreted as recommended by Cicchetti [45]: “poor” (ICC < 0.40), "fair" (0.40–0.59), “good” (0.60–0.74) and "excellent" (ICC > 0.75). Disaggregated and combined reliability estimates were computed for Montreal and Chennai for the patient and family samples. Due to the smaller size of the clinician sample at each site, only combined reliability estimates were computed. Finally, test–retest reliabilities were assessed separately for the English, French, and Tamil versions of the WRS based on combined patient and family samples.

In the standardization sample, internal consistency was computed for patient, family, and clinician samples, aggregated and disaggregated across sites. Internal consistency reliabilities were also assessed separately for the English, French, and Tamil versions of the WRS based on combined patient and family samples.

Internal consistency estimates were then calculated for confirmatory purposes using the larger study samples at both sites (see details of larger study in Part 2 of this 2-part paper series). This analysis excluded those participants whose data was included in the smaller standardization sample. Estimates were computed separately by stakeholder (patient, family and clinician); site (Montreal, Chennai); and language (English and French in Montreal; English and Tamil in Chennai).

Often, reliability estimates based on internal consistency (Cronbach’s alphas) are interpreted as acceptable if > 0.70, good if > 0.80, and excellent if > 0.90 [46]. It has been argued that values below 0.60 are acceptable for exploratory research [47, 48] and that interpretation of such estimates be guided by how the scale was conceptualized rather than based on strict cut-offs [49, 50]. In our study, it was decided a priori that the measure would be considered internally consistent if the Cronbach's alpha estimates were at least 0.60. Higher internal consistency estimates were not consistently expected as it was theorized that ratings (e.g., for government versus persons with mental health problems) could reflect not only latent values about stakeholder responsibilities (e.g., a general belief that governments should take substantial responsibility for addressing key needs of persons with mental health problems), but also be influenced by the specific need area being rated (e.g., governments could be seen as more responsible for covering the costs of mental health services than the costs of substance use services).

Results

Sample description (Table 1)

Patients at both sites (n = 30 Montreal; n = 26 Chennai) were comparable in age (mid-twenties), years of education (12 years), and gender distribution (Table 1). The WRS was completed in French by 13 patients in Montreal and in Tamil by 18 patients in Chennai, with the remaining patients responding in English at both sites. Families at both sites (n = 31 Montreal; n = 28 Chennai) differed significantly on some demographic variables. More family members in Montreal were women, were in the 51–60 age group, had greater than high school education, and were parents of patients with FEP. In Chennai, gender distribution was comparable for male and female family members, a sizeable minority of family members were in the 31–40 age group, one quarter of family members were spouses/partners, and three quarters had high school education. The WRS was completed in French by 17 family members in Montreal, and in Tamil by 24 family members in Chennai. Clinicians in Chennai were all case managers and predominantly women (86%) in the 21–30 age group (73%), compared to Montreal, where two-thirds were case-managers, gender distribution was equal, and the majority were in the 31–40 age group. Description of the larger study samples can be found in Part 2 of this 2-part paper series.

Test–retest reliability analysis (Table 2)

Table 2 Test–retest reliability based on ICC(2,1), with single measure estimates
Full size table

For the combined patient sample, the ICCs (2,1) were 0.71 (good), 0.57 (fair), and 0.57 (fair) for total responsibility ratings assigned to government versus persons with mental health problems, government versus families, and families versus persons with mental health problems, respectively. At each site, ICCs (2,1) were generally in the good range for the patient samples, with two exceptions where it was in the fair range.

For the combined family sample, the ICCs (2,1) were 0.71 (good), 0.73 (good), and 0.79 (excellent) for total responsibility ratings assigned to government versus persons with mental health problems, government versus families, and families versus persons with mental health problems, respectively. At each site, ICCs (2,1) were generally in the excellent range for the family samples, with two exceptions where it was in the good or fair range.

For the combined clinician sample, the ICCs (2,1) were 0.88 (excellent), 0.92 (excellent), and 0.77 (excellent) for total responsibility ratings assigned to government versus persons with mental health problems, government versus families, and families versus persons with mental health problems respectively.

Generally, we found excellent to good test–retest reliability for all language versions of the WRS. The exceptions were for responsibility assigned to persons with mental health problems versus families in the English version, and for responsibility assigned to the government versus persons with mental health problems and the government versus families in the Tamil version, where, in each case, the ICC (2,1) was only in the fair range.

A closer examination of raw scores across the two administrations of the WRS in Chennai indicated that the responses were in fact stable across time for the large majority of raters, with only three exceptions. Specifically, two patient raters attributed dramatically different levels of responsibility to governments versus families from Time 1 to Time 2, going from composite scores of 14 and 14, suggesting government was seen as relatively more responsible, to composite scores of 40 and 50, suggesting families were seen as relatively more responsible. Similarly, one family rater went from a composite score of 7 at Time 1 (suggesting government was seen as relatively more responsible versus persons with mental health problems) to a composite score of 61 at Time 2 (suggesting persons with mental health problems were seen as relatively more responsible). When the reliability estimates were re-calculated for Chennai after removing these three exceptions, the ICC values moved to the 0.688–0.979 (good–excellent) range (Additional file 2).

In summary, generally, responsibility ratings on the WRS tend to be stable over short time periods. Given that composite scores are based on seven items each, the dramatic change in composite scores between Times 1 and 2 in the case of the three exceptions suggests that raters' attributions of responsibility genuinely shifted over time from one stakeholder group (e.g., governments) to the other (e.g., patients), rather than erratically fluctuating over time.

Internal consistency reliability analysis (Table 3)

Table 3 Internal consistency reliability estimates for patient, family and clinician samples (overall and by site)
Full size table

For the patient sample, Cronbach's alpha estimates were good for all three sets of items (government-persons with mental health problems, government-family, and family-persons with mental health problems) for the combined Montreal and Chennai samples; excellent for the Montreal sample; and acceptable for the Chennai sample. In the family sample, Cronbach’s alphas for the three sets were between good and excellent for the combined Montreal and Chennai samples, excellent for the Montreal sample, and good to excellent for the Chennai sample. In the clinician sample, Cronbach's alphas were acceptable for the family-persons with mental health problems and the government-family set of items, and good for the government-persons with mental health problems set of items. With one exception (which was acceptable), internal consistency estimates were in the good to excellent range for the three language groups (see Table 4).

Table 4 Internal consistency-based reliability estimates across language groups
Full size table

Results from the larger sample confirmed the internal consistency of the WRS for all three stakeholder groups at each site; for the English and French versions at Montreal and the English and Tamil versions at Chennai. As indicated in Tables 5 and 6, Cronbach’s alphas generally ranged between excellent and good.

Table 5 Internal consistency for the larger study sample of patients and families
Full size table
Table 6 Internal consistency for different language groups from the larger study
Full size table

Frequency distributions of WRS scores

With a few exceptions, scores for each individual item fell in all three ranges (1–3, 4–6 and 7–10) for all stakeholder groups (patients, families, and clinicians) irrespective of site, suggesting that as intended, the scale captured variations in individuals’ views on how responsibility for meeting specific needs should be distributed. There were a small number of cases where the 7–10 portion of the scale was never endorsed (Table 7). In all these instances, these seemed to be reflective of views held by individuals in a particular context or a particular stakeholder group, and were in the expected direction; e.g., patients in Chennai never endorsed scores between 7 and 10 (suggestive of patients being substantially more responsible than families) for addressing housing needs of individuals with mental health problems. Nearly our entire sample and many young persons with and without mental health problems in India live with their families [16, 51,52,53]. Similarly, clinicians at both sites never endorsed scores between 7 and 10 (suggestive of families being substantially more responsible than the government) on the item about responsibility for covering costs of mental health services, suggesting that they saw this much more as a responsibility to be fulfilled by governments.

Table 7 WRS items which were never assigned a score between 7 and 10 at either Time 1 or Time 2 of testing
Full size table

Participant feedback

All participants completed the WRS with minimal support at both sites. Participants in Chennai (N = 10; 5 each in Tamil and English) reported that the WRS was average in terms of ease of completion (M = 4.1 ± 2.02) and comprehension (M = 4.5 ± 1.64), and 8/10 participants found it easy to answer. Feedback from Montreal participants (N = 11; 7 in English, 4 in French) suggested that the WRS was average in terms of ease of completion (M = 5.54 ± 2.94) and comprehension (M = 5.09 ± 2.73); and 6/11 participants found it easy to answer. We did not analyze separately by language given the small sample sizes, but no pattern was discernable prima facie.

Discussion

The aim of this paper was to report on the development and reliability estimates of the WRS, a self-report scale assessing stakeholders’ perceptions of the relative responsibilities of the government, persons with mental health problems, and their families in addressing the support needs of persons with mental health problems. The WRS test–retest reliability was generally found to be excellent to good across the different stakeholder groups (patients, families, and clinicians), settings (Montreal and Chennai), and languages (English, French, and Tamil). Internal consistency estimates were well within the acceptable range and the tool scored in the average range overall in terms of ease of comprehension and completion. In all, the WRS performed adequately with all stakeholder groups and in the three language groups in Chennai and Montreal.

The chief strength of this measure lies in its novelty and its focus on a construct that has generally been ignored in mental healthcare: perceptions of relative responsibility for supporting various needs of individuals with mental health problems. This issue is particularly salient at a time when mental health problems are the subject of increased attention, with substantial discussion in both HIC and LMIC contexts regarding novel infrastructures, funding, and service design. We modelled scale items on an item that has been part of the World Values Survey [32] since 1990 and has proven to be sensitive to capturing differences in individuals’ views about government and individual responsibilities for need provision across countries [54, 55]. Through this tool, we extend this focus on locus of responsibility to mental healthcare. Taken as a whole, the tool allows the assessment of relative (rather than absolute) judgments of responsibility apportioned to governments versus persons with mental health problems, governments versus families, and families versus persons with mental health problems – three key stakeholder groups in mental healthcare, irrespective of geo-cultural context. It also allows for stakeholders to hold varying views about how responsibility should be distributed based on the need area being assessed. This is important, as perceptions of responsibility may vary based on the support need in question [23]. For instance, some stakeholders may generally hold governments more responsible than persons with mental health problems or their families for covering the costs of mental health services but hold persons with mental health problems more responsible for covering the costs of treatment for substance use.

The WRS derives construct and content validity from the construct of perceptions of relative responsibility being well-supported by a critical literature review [23], and the seven need dimensions assessed by the WRS being identified on the basis of previous literature [1, 33,34,35,36,37,38,39] and focus groups conducted with patients, families, and clinicians across two different settings in Canada and India [40,41,42]. Moreover, our findings from the larger Chennai-Montreal study (presented in Part 2) indicate that the WRS can detect hypothesized differences in stakeholders’ perceptions across sites, supporting the validity of this tool. Additional investigations with specified hypotheses can be conducted (e.g., family members who assign higher levels of responsibility to families will be more involved in treatment) to establish predictive validity in future studies.

The WRS is a promising tool with policy, research, and clinical applications. Using tools like the WRS can help ensure that health policy development in specific settings is informed by inputs from all stakeholder groups regarding the priorities and perceived responsibilities of the state versus other actors. Although rarely done to date, such stakeholder consultation can result in greater clarity of roles and responsibilities, strengthened participation of all stakeholders, and citizen-informed health policy [56]. In global health research, the WRS can help measure attitudes about healthcare responsibilities, how they differ across contexts and stakeholder groups, what underpins these differences (e.g., healthcare structures, value systems, etc.), and how these attitudes shape the organization, delivery, and outcomes of health services. While the WRS has more appreciable applications in policymaking and research, clinically, the entire tool or selected items pertaining to particular need areas can be used to foster awareness, dialogue, and understanding among patients, families, and clinicians about roles and responsibilities in the treatment context. Such discussion can promote shared understanding and decision-making, and improve patient-family, patient-provider, and provider-family relationships [57].

Limitations

Our psychometric testing focused on test–retest and internal consistency reliability, with additional evaluation of the scale's ease of use. Test–retest reliability was higher for clinicians compared to patients and families, which may have resulted from them having found the tool easier to comprehend and complete. However, because the feedback questionnaires were administered only to patients, we are limited in our ability to comment on how families and clinicians perceived the tool. While the majority of patients who completed the feedback questionnaire did not perceive the WRS to be difficult to answer, a minority (7/21 patients) did. As the original intent was for the WRS to be either self-administered or interviewer-administered, we recommend flexible use of the tool, employing an interviewer-administered modality whenever necessary and feasible. However, we do recommend that the modality of administration be consistent across time for each respondent. Future research employing cognitive interviewing [58] and more in-depth user consultation may be helpful in changing instructions for greater clarity and accessibility, and perhaps even in further refining the tool. Notwithstanding the value of such future research, our current efforts are a noteworthy first-ever attempt at measuring views about the relative roles of pertinent stakeholder groups in mental healthcare.

A further limitation of our study is the relatively small size of our standardization sample. Nonetheless, we did recruit from all three stakeholder groups and in two languages (for a total of three languages overall) at both sites. In the case of the clinician group, sample size was limited by the relatively low number of clinicians at each site (most of whom participated in the study). Furthermore, we compensated for the small sample size by at least confirming the internal consistency estimates in larger samples from the main study.

Conclusion

In conclusion, the WRS is a novel and reliable measure of values related to the central issue of who should provide for which needs in mental healthcare. It can help to operationalize the notion of shared responsibility that, though rarely measured, is widely accepted as an important organizing principle for mental health services delivery and policy. Future research should be conducted in additional LMIC and HIC settings to confirm the reliability, validity and utility of this measure in other contexts.

Availability of data and materials

The measure reported on in this paper, Whose Responsibility Scale, is included as Supporting Information. To use or modify the scale, please contact its primary creator at srividya.iyer@mcgill.ca. The datasets generated and/or analysed during the current study are not publicly available due to ethics approval from participants not covering public sharing but are available from the corresponding author on reasonable request.

Abbreviations

HIC:

High-income country

HICs:

High-income countries

LMIC:

Low- and middle-income country

LMICs:

Low- and middle-income countries

WRS:

Whose Responsibility Scale

Vs:

Versus

References

  1. MHCC. Changing directions, changing lives. The mental health strategy for Canada. Calgary: Mental Health Commission of Canada; 2012.

    Google Scholar 

  2. WHO. Mental health action plan 2013–2020. Geneva, Switzerland: World Health Organization; 2013. Report No.: http://apps.who.int/iris/bitstream/10665/89966/1/9789241506021_eng.pdf?ua=1. Accessed 19 Dec 2020.

  3. Saxena S, Thornicroft G, Knapp M, Whiteford H. Resources for mental health: scarcity, inequity, and inefficiency. Lancet. 2007;370(9590):878–89.

    PubMed  Google Scholar 

  4. Vigo DV, Kestel D, Pendakur K, Thornicroft G, Atun R. Disease burden and government spending on mental, neurological, and substance use disorders, and self-harm: cross-sectional, ecological study of health system response in the Americas. Lancet Public Health. 2019;4(2):e89–96.

    PubMed  Google Scholar 

  5. WHO. Mental Health Atlas 2017. Geneva: World Health Organization; 2018. Contract No.: Licence: CC BY-NC-SA 3.0 IGO.

  6. Park DS, Han J, Torabi M, Forget EL. Managing mental health: why we need to redress the balance between healthcare spending and social spending. BMC Public Health. 2020;20(1):1–8.

    Google Scholar 

  7. Rathod S, Pinninti N, Irfan M, Gorczynski P, Rathod P, Gega L, et al. Mental health service provision in low-and middle-income countries. Health Services Insights. 2017;10:1–7.

    Google Scholar 

  8. Canada. Canada health act: annual report 2019–2020. Ottawa: Health Canada; 2021.

  9. Farkas M, Gagne C, Anthony W, Chamberlin J. Implementing recovery oriented evidence based programs: identifying the critical dimensions. Community Ment Health J. 2005;41(2):141–58.

    PubMed  Google Scholar 

  10. Le Boutillier C, Leamy M, Bird VJ, Davidson L, Williams J, Slade M. What does recovery mean in practice? A qualitative analysis of international recovery-oriented practice guidance. Psychiatr Serv. 2011;62(12):1470–6.

    PubMed  Google Scholar 

  11. Slade M, Amering M, Farkas M, Hamilton B, O’Hagan M, Panther G, et al. Uses and abuses of recovery: implementing recovery-oriented practices in mental health systems. World Psychiatry. 2014;13(1):12–20.

    PubMed  PubMed Central  Google Scholar 

  12. Anderson KK, Fuhrer R, Malla AK. “There are too many steps before you get to where you need to be”: Help-seeking by patients with first-episode psychosis. J Ment Health. 2013;22(4):384–95.

    PubMed  Google Scholar 

  13. Baronet A-M. Factors associated with caregiver burden in mental illness: a critical review of the research literature. Clin Psychol Rev. 1999;19(7):819–41.

    CAS  PubMed  Google Scholar 

  14. Lavis A, Lester H, Everard L, Freemantle N, Amos T, Fowler D, et al. Layers of listening: qualitative analysis of the impact of early intervention services for first-episode psychosis on carers’ experiences. Br J Psychiatry. 2015;207(2):135–42.

    PubMed  Google Scholar 

  15. McCann TV, Lubman DI, Clark E. First-time primary caregivers’ experience accessing first-episode psychosis services. Early Interv Psychiatry. 2011;5(2):156–62.

    PubMed  Google Scholar 

  16. Avasthi A. Preserve and strengthen family to promote mental health. Indian Journal of Psychiatry. 2010;52(2):113–26.

    PubMed  PubMed Central  Google Scholar 

  17. Faqurudheen H, Mathew S, Kumar TM. Exploring family resilience in a community mental health setup in south India. Procedia Economics and Finance. 2014;18:391–9.

    Google Scholar 

  18. Kakuma R, Minas H, Van Ginneken N, Dal Poz MR, Desiraju K, Morris JE, et al. Human resources for mental health care: current situation and strategies for action. The Lancet. 2011;378(9803):1654–63.

    Google Scholar 

  19. Hervik SEK, Thurston M. ‘It’s not the government’s responsibility to get me out running 10 km four times a week’-Norwegian men’s understandings of responsibility for health. Crit Public Health. 2016;26(3):333–42.

    Google Scholar 

  20. Fan R. Which care? Whose responsibility? And why family? A Confucian account of long-term care for the elderly. J Med Philos. 2007;32(5):495–517.

    PubMed  Google Scholar 

  21. Koschorke M, Padmavati R, Kumar S, Cohen A, Weiss HA, Chatterjee S, et al. Experiences of stigma and discrimination of people with schizophrenia in India. Soc Sci Med. 2014;123:149–59.

    PubMed  PubMed Central  Google Scholar 

  22. Karp DA, Watts-Roy D. Bearing responsibility: how caregivers to the mentally ill assess their obligations. Health. 1999;3(4):469–91.

    Google Scholar 

  23. Pope MA, Malla AK, Iyer SN. Who should be responsible for supporting individuals with mental health problems? A critical literature review. Int J Soc Psychiatry. 2018;64(3):293–302.

    PubMed  Google Scholar 

  24. Corrigan PW, Watson AC. Factors that explain how policy makers distribute resources to mental health services. Psychiatr Serv. 2003;54(4):501–7.

    PubMed  Google Scholar 

  25. Colizzi M, Lasalvia A, Ruggeri M. Prevention and early intervention in youth mental health: is it time for a multidisciplinary and trans-diagnostic model for care? Int J Ment Heal Syst. 2020;14:1–14.

    Google Scholar 

  26. Hetrick SE, Bailey AP, Smith KE, Malla A, Mathias S, Singh SP, et al. Integrated (one-stop shop) youth health care: best available evidence and future directions. Med J Aust. 2017;207(S10):S5–18.

    PubMed  Google Scholar 

  27. Malla A, Iyer S, McGorry P, Cannon M, Coughlan H, Singh S, et al. From early intervention in psychosis to youth mental health reform: a review of the evolution and transformation of mental health services for young people. Soc Psychiatry Psychiatr Epidemiol. 2016;51(3):319–26.

    PubMed  Google Scholar 

  28. Iyer SN, Malla A, Taksal A, Maraj A, Mohan G, Ramachandran P, et al. Context and contact: a comparison of patient and family engagement with early intervention services for psychosis in India and Canada. Psychol Med. 2020. https://doi.org/10.1017/S0033291720003359.

    Article  PubMed  Google Scholar 

  29. Malla A, Iyer SN, Rangaswamy T, Ramachandran P, Mohan G, Taksal A, et al. Comparison of clinical outcomes following 2 years of treatment of first-episode psychosis in urban early intervention services in Canada and India. Br J Psychiatry. 2020;217(3):514–20.

    PubMed  Google Scholar 

  30. Iyer S, Jordan G, MacDonald K, Joober R, Malla A. Early intervention for psychosis: a Canadian perspective. J Nerv Ment Dis. 2015;203(5):356–64.

    PubMed  Google Scholar 

  31. First MB, Spitzer RL, Gibbon M, Williams JB. Structured clinical interview for DSM-IV-TR axis I disorders, research version, patient edition (SCID-I/P). New York: Biometrics Research, New York State Psychiatric Institute; 2002.

  32. Inglehart R, Haerpfer C, Moreno A, Welzel C, Kizilova K, Diez-Medrano J, et al. (eds.). 2014. World Values Survey: Round Six - Country-Pooled Datafile Version: http://www.worldvaluessurvey.org/WVSDocumentationWV6.jsp. Madrid: JD Systems Institute. http://www.worldvaluessurvey.org/WVS.

  33. Browne G, Courtney M. Housing, social support and people with schizophrenia: A grounded theory study. Issues Ment Health Nurs. 2005;26(3):311–26.

    PubMed  Google Scholar 

  34. Cohen KR, Peachey D. Access to psychological services for Canadians: Getting what works to work for Canada’s mental and behavioural health. Can Psychol. 2014;55(2):126–30.

    Google Scholar 

  35. Fossey EM, Harvey CA. Finding and sustaining employment: a qualitative meta-synthesis of mental health consumer views. Can J Occup Ther. 2010;77(5):303–14.

    PubMed  Google Scholar 

  36. Gardner DM, Baldessarini RJ, Waraich P. Modern antipsychotic drugs: a critical overview. Can Med Assoc J. 2005;172(13):1703–11.

    Google Scholar 

  37. Harvey C, Killackey E, Groves A, Herrman H. A place to live: Housing needs for people with psychotic disorders identified in the second Australian national survey of psychosis. Aust N Z J Psychiatry. 2012;46(9):840–50.

    PubMed  Google Scholar 

  38. Killackey EJ, Jackson HJ, Gleeson J, Hickie IB, McGorry PD. Exciting career opportunity beckons! Early intervention and vocational rehabilitation in first-episode psychosis: employing cautious optimism. Aust N Z J Psychiatry. 2006;40(11–12):951–62.

    PubMed  Google Scholar 

  39. Rinaldi M, Killackey E, Smith J, Shepherd G, Singh SP, Craig T. First episode psychosis and employment: a review. Int Rev Psychiatry. 2010;22(2):148–62.

    PubMed  Google Scholar 

  40. Iyer S, Loohuis H, Pope M, Rangaswamy T, Malla A. Family factors in first-episode psychosis in Chennai, India and Montreal, Canada: a mixed-method study: B27. Early Interv Psychiatry. 2014;8:104.

    Google Scholar 

  41. Iyer S, Pope M, Loohuis H, Schorr E, Rangaswamy T, Malla A. First-episode psychosis in Chennai, India and Montreal, Canada: a mixed method approach to the study of family factors across contexts. Eur Arch Psychiatry Clin Neurosci. 2015;265:S63.

    Google Scholar 

  42. Pope MA, Jordan G, Venkataraman S, Malla AK, Iyer SN. “Everyone has a role”: perspectives of service users with first-episode psychosis, family caregivers, treatment providers, and policymakers on responsibility for supporting individuals with mental health problems. Qual Health Res. 2019;29(9):1299–312.

    PubMed  Google Scholar 

  43. WHO. Process of translation and adaptation of instruments. Geneva: World Health Organization; 2019.

    Google Scholar 

  44. Shrout PE, Fleiss JL. Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 1979;86(2):420–8.

    CAS  PubMed  Google Scholar 

  45. Cicchetti DV. Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychol Assess. 1994;6(4):284–90.

    Google Scholar 

  46. George D, Mallery E. SPSS for Windows step by step: a simple guide and reference. 11.0 Update. Boston: Allyn & Bacon; 2003.

    Google Scholar 

  47. Hair J, Black W, Babin B, Anderson R. Multivariate Data Analysis: A Global Perspective. 7th ed. New Jersey: Pearson Education, 2010.

  48. Taber KS. The use of Cronbach’s alpha when developing and reporting research instruments in science education. Res Sci Educ. 2018;48(6):1273–96.

    Google Scholar 

  49. Cho E, Kim S. Cronbach’s coefficient alpha: well known but poorly understood. Organ Res Methods. 2015;18(2):207–30.

    Google Scholar 

  50. Cortina JM. What is coefficient alpha? An examination of theory and applications. J Appl Psychol. 1993;78(1):98–104.

    Google Scholar 

  51. Chadda RK, Deb KS. Indian family systems, collectivistic society and psychotherapy. Indian J Psychiatry. 2013;55(Suppl 2):S299.

    PubMed  PubMed Central  Google Scholar 

  52. Dommaraju P. Living alone in India: gender and policies. Glob Soc Secur Rev. 2019;11:50–9.

    Google Scholar 

  53. Srinivasan TN, Thara R. At issue: management of medication noncompliance in schizophrenia by families in India. Schizophr Bull. 2002;28(3):531–5.

    PubMed  Google Scholar 

  54. Andersen R, Curtis J. Social class, economic inequality, and the convergence of policy preferences: evidence from 24 modern democracies. CRS/RCS. 2015;52(3):266–88.

    PubMed  Google Scholar 

  55. Pitlik H, Rode M. Individualistic values, institutional trust, and interventionist attitudes. WIFO Working Papers; 2016. https://doi.org/10.1017/S1744137416000564

  56. Canada H. Health Canada Policy Toolkit for Public Involvement in Decision Making. Ottawa: Minister of Public Works and Government Services Canada; 2000.

    Google Scholar 

  57. Wittenberg Y, Kwekkeboom R, Staaks J, Verhoeff A, de Boer A. Informal caregivers’ views on the division of responsibilities between themselves and professionals: a scoping review. Health Soc Care Community. 2018;26(4):e460–73.

    PubMed  Google Scholar 

  58. Beatty PC, Willis GB. Research synthesis: the practice of cognitive interviewing. Public Opin Q. 2007;71(2):287–311.

    Google Scholar 

Download references

Acknowledgements

We would like to thank the Montreal and SCARF patients, families, and teams. Specifically, we would like to thank Drs Mangala Ramamurthy, Shivaprakash Srinivasan and T.C. Rameshkumar, and Helen Martin, Sneha Natarajan, Arthy Jayavel, Shruthi Rao and Anjhana Krishnamoorthi who contributed to service delivery and data collection at SCARF. From the Montreal team, we would like to thank Nicole Pawliuk, Kevin MacDonald, Geraldine Etienne and Emily Schorr for supporting data collection, data management and project coordination.

Funding

The author(s) disclosed receipt of the following financial support for the research, authorship and/or publication of this article: This research was funded by an R-01 grant (no. 5R01MH093303- 05) and an associated supplemental grant (no. R01MH093303-04) from NIH. Iyer received a salary award from the Canadian Institutes of Health Research and a salary award from the Fonds de recherche du Québec–Santé. Malla was funded by the Canada Research Chairs program and Shah by a salary award from Fonds de Recherche Quebec – Santé. The funding source had no further role in study design, data collection and analysis, writing of the report, and in the decision to submit the report for publication.

Author information

Authors and Affiliations

  1. Department of Psychiatry, McGill University, Montreal, QC, Canada

    Srividya N. Iyer, Jai Shah, Ridha Joober, Norbert Schmitz, Howard C. Margolese & Ashok Malla

  2. Prevention and Early Intervention Program for Psychosis (PEPP-Montreal), Douglas Mental Health University Institute, Montreal, QC, Canada

    Srividya N. Iyer, Megan Pope, Aarati Taksal, Jai Shah, Ridha Joober & Ashok Malla

  3. Schizophrenia Research Foundation (SCARF), Chennai, India

    Greeshma Mohan, Thara Rangaswamy & Ramachandran Padmavati

  4. McGill University Student Services, McGill University, Montreal, QC, Canada

    Heleen Loohuis

  5. Department of Population-Based Medicine, Institute of Health Sciences, University Hospital Tübingen, Tübingen, Germany

    Norbert Schmitz

  6. Prevention and Early Intervention Program for Psychosis (PEPP-MUHC), McGill University Health Centre, Montreal, Canada

    Howard C. Margolese

Authors
  1. Srividya N. Iyer
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Megan Pope
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Aarati Taksal
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Greeshma Mohan
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Thara Rangaswamy
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Heleen Loohuis
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Jai Shah
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Ridha Joober
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Norbert Schmitz
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Howard C. Margolese
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Ramachandran Padmavati
    View author publications

    You can also search for this author in PubMed Google Scholar

  12. Ashok Malla
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

SNI, MP, HL & GM contributed to scale design. AM, SNI, TR, MP, PR, RJ, JS, HCM, & NS contributed to conception of the larger project that included scale development and testing. SNI, AM, TR, GM, MP & PR contributed to data acquisition. AT conducted the analyses with inputs from SNI & AM. SNI, AT & MP wrote the first draft of the manuscript. All authors reviewed the draft and provided critical inputs. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Srividya N. Iyer.

Ethics declarations

Ethics approval and consent to participate

The study was approved by the relevant institutional ethics boards in Montreal and Chennai. All participants gave informed consent. In the case of individuals younger than 18 years, participants provided assent and their parents/guardians provided consent.

Consent for publication

Not applicable.

Competing interests

The authors have no competing interests with respect to this paper.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1.

Whose Responsibility Scale, patient version.

Additional file 2.

Table: ICC values after excluding data of Chennai participants with very divergent Time 1 and Time 2 scores on the WRS.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Iyer, S.N., Pope, M., Taksal, A. et al. Whose responsibility? Part 1 of 2: A scale to assess how stakeholders apportion responsibilities for addressing the needs of persons with mental health problems. Int J Ment Health Syst 16, 1 (2022). https://doi.org/10.1186/s13033-021-00510-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13033-021-00510-x

Keywords

International Journal of Mental Health Systems

ISSN: 1752-4458