Skip to main content
Download PDF

Developing a Theory of Change model of service user and caregiver involvement in mental health system strengthening in primary health care in rural Ethiopia

International Journal of Mental Health Systems volume 14, Article number: 51 (2020) Cite this article

Abstract

Background

The involvement of service users and caregivers is recommended as a strategy to strengthen health systems and scale up quality mental healthcare equitably, particularly in low-and-middle-income countries. Service user and caregiver involvement is complex, and its meaningful implementation seems to be a worldwide challenge. Theory of Change (ToC) has been recommended to guide the development, implementation and evaluation of such complex interventions. This paper aims to describe a ToC model for service user and caregiver involvement in a primary mental health care in rural Ethiopia.

Methods

The ToC was developed in two workshops conducted in (i) Addis Ababa with purposively selected psychiatrists (n = 4) and multidisciplinary researchers (n = 3), and (ii) a rural district in south-central Ethiopia (Sodo), with community stakeholders (n = 24). Information from the workshops (provisional ToC maps, minutes, audio recordings), and inputs from a previous qualitative study were triangulated to develop the detailed ToC map. This ToC map was further refined with written feedback and further consultative meetings with the research team (n = 6) and community stakeholders (n = 35).

Results

The experiential knowledge and professional expertise of ToC participants combined to produce a ToC map that incorporated key components (community, health organisation, service user and caregiver), necessary interventions, preconditions, assumptions and indicators towards the long-term outcomes. The participatory nature of ToC by itself raised awareness of the possibilities for servicer user and caregiver involvement, promoted co-working and stimulated immediate commitments to mobilise support for a grass roots service user organization.

Conclusions

The ToC workshops provided an opportunity to co-produce a ToC for service user and caregiver involvement in mental health system strengthening linked to the planned model for scale-up of mental health care in Ethiopia. The next steps will be to pilot a multi-faceted intervention based on the ToC and link locally generated evidence to published evidence and theories to refine the ToC for broader transferability to other mental health settings.

Introduction

The involvement of service users and their caregivers at all levels of the mental health system has become a core policy in many countries across the world [1,2,3]. There is lack of consensus about what precisely definition of service user and caregiver involvement, and there are many terms used often interchangeably (e.g. patient/caregiver engagement/co-production, consumer/family participation, patient and public involvement) in the literature [1, 4, 5]. In this study, service user and caregiver involvement is defined as the active involvement by service users, caregivers and their representatives in decision-making within mental health system in a range of activities including, policy making, planning, service development and delivery, monitoring and evaluation or quality assurance, research, training and education, peer support and case management, and advocacy within the health system starting from their expertise gained from experience [1]. The involvement of service user and caregiver can take place at multiple levels: the micro-level (e.g. in individual care decision-making, planning and management), meso-level (e.g. in local service planning, monitoring and evaluation, advocacy, training and recruitment of staff, input into guidelines), and macro-level (e.g. policy making, national level planning and advocacy) [1, 5, 6].

There is explicit international policy direction from the World Health Organization for national mental health systems to empower and involve service users in mental health system strengthening [7, 8]. The same directive has become a policy imperative and is therefore firmly embedded in policy documents of many high income countries [3, 9].

There is evidence from high income countries of many benefits of service user and caregiver involvement for: (i) the healthcare system (e.g., better access to, and acceptability of health care services) [10, 11]; (ii) for health professionals (e.g., improved attitudes, better understanding of service users’ and caregivers’ needs) [10,11,12,13], and (iii) improved knowledge about mental health and available services, and networking among service users and caregivers [10,11,12,13].

In low-and-middle income countries (LMICs), service user and caregiver involvement has been widely recommended as an essential ingredient of strengthening weak mental health systems [14, 15], which has potential to increase the likelihood of scale-up of appropriate and quality mental healthcare [16, 17], and reduce the treatment gap for quality care [8, 18]. However, in LMICs, there is less prioritization and government support for either mental healthcare provision or involvement of service users [19, 20]. Furthermore, there are often no policies and laws to direct mental health programs and/or the policies and laws are not fully in line with human rights recommendations (e.g., service user participation) or are poorly implemented [19, 20]. Service users and caregivers are still exposed to stigma and discrimination [21, 22] and have multiple unmet needs [22], including symptoms of illness and disability [23], premature mortality [24, 25], and human rights abuses (e.g., being chained or kept in isolation) [21, 26, 27].

While the importance of service user and caregiver involvement in the mental health system is clear, the question of how to implement participation in practice remains a global challenge. The involvement of services and caregivers is a complex process that (1) has been variously defined [1, 5]; (2) is characterized by multiple and often inequitable interactions at the micro-level, the meso-level, and at the macro-level [1, 6, 28]; and (3) requires resources and actions of actors at multiple levels to build a supportive environment [1, 12, 29]. This complexity can be a barrier to developing consensus in relation to (i) the meaning of involvement, (ii) understanding the goals, (iii) identifying the appropriate model and (iv), the expectations, roles and responsibilities of stakeholders for service user and caregiver involvement [1, 11, 30, 31]. Recommended approaches to complex intervention development and implementation [32] have not been applied to articulate what the complex nature of service user involvement might look like in practice [1, 6, 28].

A growing body of development and health actors recommend Theory of Change (ToC) for dealing with complex health interventions [33,34,35]. ToC has been adopted in some LMICs, including Ethiopia, to develop, implement and evaluate interventions in mental healthcare [34, 36, 37]. ToC is a participatory approach to explore processes for change; “a theory of how and why an initiative works” [38], which both develops an intervention using the experience and expertise of the participants, and documents key indicators that allow systematic evaluation of processes and outcomes of the intervention (e.g., service user and caregiver involvement) for expected steps on the hypothesized causal pathway to impact [35]. Furthermore, several scholars suggested that ToC gives insights not only into intended change, but also the model of action or practice and unforeseen consequences [39,40,41].

However, there is little published evidence of the application of ToC to the involvement of service user and caregivers in mental health system strengthening. The main objective of this study was, therefore, to describe our experiences of bringing together service users, caregivers, and other key stakeholders to use a ToC approach to develop a model of how best to involve service user and caregivers in mental health system strengthening in primary healthcare in rural Ethiopia.

Methods

Setting

This study was conducted as part of the ‘Emerging mental health systems in low- and middle-income countries’(Emerald) project, which investigated the health system requirements for successful improvement of integrated mental health care in six LMICs(Ethiopia, India, Nepal, Nigeria, South Africa and Uganda) [42, 43]. Emerald built upon the PRogramme for Improving Mental health carE (PRIME), an implementation research project which developed, implemented and evaluated an integrated district mental health care plan in collaboration with local stakeholders [44, 45].

This study was undertaken at both the national level in the capital city, Addis Ababa, and the district level in Sodo district, Gurage Zone, located about 100 km south of Addis Ababa. Sodo district had a population of 161 952 people in 2007 [46]. Around 90% of the district population resides in rural areas and most are reliant on subsistence farming [47]. Most of the population in the district follow Orthodox Christianity and are from the Gurage ethnic group. The official language of the district is Amharic [46]. There is one primary hospital with an outpatient psychiatric service in the main town, and eight health centres, four of which are located within the three towns of the district. The primary hospital and all eight health centres have functioning mental health services, developed and implemented recently as part of PRIME [44, 45]. The primary hospital is staffed by a psychiatric nurse and the health centres have general health workers (health officers, nurses and midwives) trained in mental healthcare according to the World Health Organization’s mental health Gap Action Programme (mhGAP) [48]. Each health centre serves a population of about 25,000–40,000 people [49]. Each sub-district has a health post (lowest statutory healthcare facility), covering 3000–5000 population. The health posts are staffed by a pair of community health workers called health extension workers (HEWs). The HEWs are high school graduates with 1 year of training in prevention and promotion activities [50]. A minority of HEWs have received government training in mental health as part of their upgrading to level IV. PRIME has also provided capacity building training for HEWs, in addition to facility-based workers, and established a multi-sectoral community health advisory board (CAB) [51]. The CAB includes representation from key members of the district leadership (security, gender office, women and youth affairs, religious affairs and education), the community and service users and caregivers, and is chaired by the head of the district health office [52]. The CAB meets twice a year to oversee and advise PRIME and support strengthening of the mental health system [51].

ToC workshop participants

Two ToC workshops were held in 2017 to engage stakeholders in tackling the challenge of how best to embed service user and caregiver involvement in mental health system strengthening. The first ToC workshop was carried out with seven participants (three male, four female) from Addis Ababa University, Department of Psychiatry, who had extensive experience working to expand mental health care in the study site, as well as experience working with service users and advising the Federal Ministry of Health on policy and service planning. The participants had diverse professional backgrounds (psychiatry, psychology, social work, pharmacology, epidemiology, public health).

The second ToC workshop took place in Sodo, and involved 24 participants selected purposively [53] on the basis of being key stakeholders in mental healthcare or possessing expertise in service planning. The participants included: (i) district level government office representatives(managers of the district health administration, focal person for mental health, women and children’s office, youth and sport office, social affairs office), (ii) community-based organizations and leaders (religious and faith-based leaders, non-governmental organization representatives), (iii) representatives of service providers, service users and caregivers, and (iv) five senior mental health researchers from Addis Ababa University who had also participated in the first ToC workshop to provide cross-learning and link local perspectives with national scale-up plans.

Procedures

The ToC development underwent five iterative activities in three stages (See Fig. 1 for a schematic depiction of the process).

Fig. 1
figure1

ToC development process

Full size image

The first stage involved provisional ToC development using workshops. The first ToC workshop was conducted at Addis Ababa University in April 2017. The second ToC workshop was conducted in Sodo district in July 2017. The ToC was co-facilitated by senior psychiatrists and researchers (AF and CH). Both authors are trained in the use of ToC and had experience of facilitating ToC workshops with diverse stakeholders, including the PRIME project that involved most of the participants who participated in this study. As mental health professionals, both AF and CH were mindful of how they would be perceived by the participants and sought to emphasise that the focus of involvement went beyond narrow biomedical concerns. Power differentials between the facilitators and the Sodo participants were reduced by building on existing collaborative relationships where trust has been build up and participants are comfortable expressing opinions. In both workshops, the facilitators introduced and stated the objectives of the workshop, provided a brief description of the ToC approach and moderated discussions. The processes used to create the ToCs started by defining the desired impact and long–term outcomes, and then worked backwards iteratively to map out preconditions, interventions, assumptions and indicators to generate desired change [33]. The process was assisted by writing down the preconditions, interventions, assumptions, and indicators suggested by the participants on sticky notes on a wall. The two workshops led to two provisional ToC roadmaps.

Second stage, SA drafted the ToC by combining the provisional ToC road maps, minutes of the workshops and inputs from a formative qualitative study detailed elsewhere [54]. In that qualitative study, in-depth interviews were conducted with policy makers/planners, health professionals/facility heads, service users and caregivers from the current study setting and at the national. We found that all groups of participants supported service user and caregiver involvement in mental health system strengthening; however, hardly any respondents had prior experience of service user involvement. Key barriers to involvement identified included limited knowledge of stakeholders about how to work together, service user/caregiver lack of experience and opportunities to be involved, lack of service user networks/associations, and lack of systemic collaboration among stakeholders to support service user involvement. Pervasive stigmatizing attitudes and discrimination operating at multilevel (the health system, the local community and individuals) tended to disqualify service user and caregiver involvement from full social acceptance, marginalize them and hinder their active involvement. All groups of respondents identified a need for awareness-raising and training to equip service users, caregivers, service providers and local community for effective involvement. The findings of the study informed the development of the ToC, particularly to triangulate components of the interventions, barriers, facilitators, and capacity building needs for participation.

The third stage of the ToC development process involved further stakeholder consultation to refine the ToC, comprising: (1) core research team written feedback, (2) consultation meeting with professionals(n = 6, e.g. psychology, social work, public health, psychiatry, epidemiology backgrounds), and (3) Community stakeholder group meeting.

The revised ToC was then discussed and validated in a half-day face-to-face meeting with stakeholder groups including service users (n = 7), caregivers (n = 5), health professionals (n = 8), leaders of statutory and non-statutory organisations (n = 15). The workshop was convened at Sodo district and held in August 2019. After a brief presentation to recap the ToC process and existing ToC map, the group was encouraged to refine and validate the draft ToC against the practical problems encountered in the local district and their knowledge, e.g. of what may work in this context.

Data collection

The data for this study came mainly from the workshops and meeting minutes, and the provisional ToC maps developed during the workshops. The first ToC workshop was audio-recorded and notes were taken by the first author. These formed the basis for a detailed report of the ToC, which was checked against the audio files for completeness. In the second ToC workshop, minutes were taken. The first (national level) workshop lasted 3:30 h, and the ToC in Sodo district lasted 2:10 h. Data from the formal process documentation of ToC workshops, the two draft ToC maps and consultation meetings were reviewed and combined to develop the final ToC map. We included in the result some illustrative quotes from the minutes checked with first author notes and audio-recordings.

Results

The details of the ToC workshop participants are presented in Table 1. The following sections will describe details of (i) the finally agreed ToC map (Fig. 2) and (ii) narratives of the process of ToC development to highlight the programme levels, preconditions, assumptions [1,2,3,4,5,6,7,8], indicators (i–iv), and interventions (a–e).

Table 1 Theory of Change workshop participants
Full size table
Fig. 2
figure2

ToC map for developing service user and caregiver involvement in mental health system strengthening in rural Ethiopia. Example assumptions: Willingness to (1) involve in ToC workshop, (2) undergo consultative workshop on service user and caregiver mobilization and support, (3) undergo participatory capacity building training(4) form collaborative community (5) involve in participatory action plan development, implementation and evaluating the ToC for service user and caregiver involvement ;(6) Availability of reliable medication supply; (7) CAB’s willingness to mobilize resources to service user and caregiver; (8) Non-governmental organization support to service user and caregiver. Example indicators: i. Number of people participated in ToC workshop, consultative workshop, capacity building training and involvement plan. ii. Changes in knowledge and perception pre and post training, experiences gained developing and evaluating the plan for service user and caregiver involvement. iii. Service user and caregiver groups established, and support generated. iv. Experience of involvement in participatory action plan development, implementation and evaluation. Example interventions a. Conduct (a) ToC workshop, (b) consultative workshop (c) capacity building participatory training, (d) facilitate participatory involvement in mental health system, (e) Assist service user and caregiver and their group

Full size image

Consensus on outcomes and impact

In the first ToC workshop, the participants suggested (i) improved quality of mental healthcare as the long-term outcome and (ii) better quality of life for service users and caregivers as the ultimate impact of the study. In contrast, members of the second ToC workshop advocated for enhanced (i) physical and mental health, (ii) work productivity, (iii) social inclusion for service users (e.g. Community activities);(iv) improved life satisfaction and (v) economic capacity for caregivers as long-term outcomes. Furthermore, reduced (vi) homelessness and (vii) mortality of service users was identified as a desired impact that went beyond the ceiling of accountability of the project. During the follow-up consultation meetings, the participants came to a consensus on the long-term outcomes, leading to minor modifications to the impact (improved quality of life and reduced mortality of service users in the district). During meetings with health professionals and researchers, concern was expressed about the feasibility of some aspects of the long-term outcome (e.g., work productivity and economic capacity). This concern was presented to stakeholder groups at the meeting at Sodo district and stimulated a heated discussion, with the group expressing their firm belief in the necessity and feasibility of the outcomes. Some participants justified the ambitious long-term outcomes, recounting that they, at the beginning of the PRIME project, had been pessimistic about the viability of integration of mental health care within primary care in the district, but that their perspectives had changed in a very relatively short time after seeing what could be achieved. For example, one participant from the health professional stakeholder group stated:

“When PRIME project conducted its project sensitization workshop, I and many of my acquaintances who attended that meeting considered many of the project objectives as impossible dreams and mere wishes….but now in a very short time all became true…we have mental health service integrated at primary healthcare delivered with professionals working there, which reduced enormous problems families used to struggled with… maybe this is the best experience that others can take … now we have many experiences….no doubt if we collaboratively work and tap our rich social capital of supporting each another and effectively use our community resources….. we can achieve.” (Health professional at Sodo district)

The positive changes observed in service users with severe mental health conditions after accessing the new service, now productively working, attending school, farming, and carrying out their daily home routines, were given as evidence of the achievability of the outcomes. In addition, the district government commitment and action to cover costs of medication, combined with an emerging government focus on community-based care and economic empowerment of people under difficult circumstances were considered conducive to success.

The participants identified the necessary interventions and preconditions to be in place to achieve the outcomes (See Table 2).

Table 2 Summary of level of intervention, key tasks, intervention and preconditions
Full size table

Interventions

In the first ToC workshop, participants emphasized three programme levels (service users, caregivers, and district health organisation) where interventions would be necessary. The participants from the second workshop added ‘local community’ as an important additional level. During the meeting with researchers and particularly stakeholder groups, the participants spent much time unpacking the changes and inputs needed from different actors at different layers of the community (e.g., leaders of social organizations, faith-based organizations) and interventions at the community programme level. The final ToC roadmap included four programme levels: i) local community, ii) district health organisation (service providers and health service managers), iii) service users, and iv) caregivers. For each level, various interventions and distinct preconditions (see Table 2) were identified by the participants as necessary steps towards achieving the long-term outcomes.

Community level

The participants of the ToC workshops reflected on the challenges of the service users and caregivers in the local setting, because they tended to be excluded from social participation in the community, and tended to be of lower socio-economic status or unemployed and at risk of lack secure housing, food, clothing and abuse of their rights. There was no organized community support for service users and caregivers, except the ad hoc contributions of individuals who were supporting some service users on a voluntary basis. The participants identified various barriers (e.g., low awareness about mental illness in the community, lack of service user and caregiver organizations) that needed to be addressed in their local settings. During the two workshops and meetings, the need for community mobilization was prioritized to overcome the socio-economic challenges of service users and caregivers and to empower them to contribute to the strengthening of the mental health system. At the subsequent consultation meetings, several actors, preconditions and interventions were added to the community programme level. For example, participants recommended expanding the composition of the CAB to include more faith-based organizations, traditional healers, social association leaders (e.g., Idir; burial societies), HEWs, development agents, and health development army leaders (community health volunteers). The participants emphasised the need to identify and work with these actors as champions at the community level for the following reasons: to facilitate community awareness raising about mental health/illness, to promote roles of service users and caregivers, to help to mobilise community resources, and to expand community-based psychosocial care for mental health. The CAB was assumed to serve as a vital platform for information sharing, community dialogue, strengthening collaborations and involvement of local statutory bodies (e.g., district health office, justice, social and labor affairs) and non–statutory organizations (e.g., social associations, religious and faith-based organization, non-governmental organizations) to organize and support self-help groups (e.g., orphan support group, caregiver organization, service user organization), as well as to overcome the barriers to involvement and facilitate the recovery of service users. HEWs were identified as the key actors for awareness raising activities and stigma reduction in the wider community, due to their links with community leaders, and close relationships to the community and health facility. The recognition of mental health as a key package in the health extension programme was raised in support of the proposal.

The participants made strong verbal commitments to work together, although working plans for specific outcomes still needed to be drawn up (e.g., processes or procedures for awareness raising, packages of training at community level). Participants’ verbal feedback indicated that the ToC process helped to clarify how programme level actors saw their roles and how they could work together. For example, one participant from the stakeholder leaders group explained how the process of ToC development had been helpful:

‘The discussion was really a learning forum, really forces us to put our thoughts and experiences that we have been doing the last five or so years… discussion helped us critically reflect what we have done so far; the reflection in the process stood out in what we have discussed during the previous ToC workshop; this also pointed to what we are going to work as in a government strategic direction, to strengthen what we have done in PRIME, also showed what we have not done well and where we need to improve particularly strengthening collaboration and CAB….it has been great. (District official)

As shown on the ToC map and Table 2, at the community level, the participants articulated key preconditions to achieve the intended long-term outcome. In particular, the need for strengthening service user and caregiver associations to function as an important partner in healthcare service improvement was stressed at all levels of the ToC development process. The participants recommended working with the CAB of the PRIME project. During the meeting with stakeholders in Sodo district, priority was given to the need for capacity building training for CAB members and key community leaders to enable them to promote community level awareness raising about mental health/illness, to reduce the impact of stigma and discrimination associated with mental illness and promote the human rights of service users and caregivers. Some participants advised that mental health promotion should be linked to schools.

Health organization (service providers/managers) level

The workshop participants appreciated the initiative by the government and PRIME to integrate mental health services into primary healthcare, and thus to provide accessible mental healthcare in Sodo district. In order to ensure ongoing sustainability of mental health services, participants identified the following as crucial: to equip healthcare centres with adequate medication supplies, and ensure continued availability of competent, compassionate, respectful and caring service providers. Unreliable medication supplies were raised by both service providers and users as a source of dissatisfaction. During the stakeholder meeting, the officials described several efforts to improve the conditions of service users and practical measures taken since the first ToC workshop (e.g., housing, community-based initiatives to support service users). All the stakeholder groups appreciated these efforts, particularly the commitment of the district health office to improve medication affordability through alternative solutions to cover the costs for those who cannot afford to pay. However, the lack of a consistent supply of psychotropic medications remained a severe problem. The root cause of the problem was a point of heated discussion, with accusations of discrimination against mental health care when compared to physical health service delivery. For example, one health professional currently working in the district administration stated:

“We have enough money to cover the psychotropic medication, but the problem is unavailability of the medication at stock even sometimes in Emmanuel Hospital…is not in the essential medicines list in their procurement processes. This is lack of attention to mental health and service users within the health systems…human rights violation …we can do or perfectly capable of doing this, but negligence… for example, after PRIME we started doing many things by ourselves.” (District health official)

The participants discussed the need to advocate and create pressure at federal level about the medication supply problem. The importance of empowering service user associations to advocate for their rights was underlined.

Communication problems between recipients and providers of care, lack of relevant evidence-based information for service users and caregivers about mental health treatment options, including medication types and side effects, were also highlighted as a barrier to better involvement. Staff expressed the need for training about how best to collaborate and involve service users and caregivers within the healthcare system. Several preconditions were articulated, together with necessary interventions (see Table 2) at the health organization level to achieve the intended long-term outcome.

Service user and caregiver level

The participants voiced their concerns about the lack of service user and caregiver involvement in the mental healthcare system in Sodo district. In the qualitative formative study [54], several barriers to involvement were identified, including severity of mental health condition and lack of a service user and caregiver organization and empowerment. The qualitative study and ToC workshops participants demanded the establishment of an effective service users-caregivers association. The ToC workshop participants listed several tasks that service users-caregivers and their organizations could accomplish to support health system strengthening (e.g., serve as pathways to enhance advocacy for mental health, peer support; see Table 2). The ToC workshop participants debated about the best focus for a new service user and caregiver organization. In the first ToC workshop it was proposed to cover the entire Sodo district, but in the second workshop the participants agreed to start in the capital town (Buie) of the district and gradually scale up because of topographical, logistical and other perceived challenges.

The workshop participants agreed that the district health office needed to take responsibility to facilitate the establishment of representative service user and caregiver organizations, with technical support, e.g. draft charter, to be provided from researchers and professionals in the area of developing policy/charters. The district health office made a public commitment to support establishment of a service user and caregiver association in the district, including the process of certification to become a legal entity. Stakeholders drew on their experience and recommended adopting the model used for HIV/AIDS associations.

At the service users-caregivers programme level, several interventions were identified (See Table 2), including the need for capacity building training for service users-caregivers and to promote the role of non-governmental organizations (e.g. the recently established Mental Service Users Association at Addis Ababa, the Mental Health Society of Ethiopia), and professionals and researchers to empower service user and caregiver for meaningful involvement. The ToC workshops participants also articulated pre-conditions (see Table 2) to be achieved at this level to reach the intended long-term outcome.

Key assumptions, evidence and indicators

Our ToC identified several assumptions (e.g. willingness of actors to work collaboratively) deemed necessary to be in place for the outcomes to be achieved. The ToC also outlined indicators of success (e.g., comprehensiveness of mental healthcare at primary health, stakeholder satisfaction), as well as the key rationale for the programme along the ToC causal pathway to the intended long-term outcome. A summary of the key assumptions, evidence/experience base and indicators to reach the long-term outcome and intermediate outcomes at the four levels is presented in Table 3.

Table 3 Key assumptions, evidence and indicators
Full size table

Discussion

In this study, we report about the development of a Theory of Change (ToC) which aimed to integrate service user and caregiver involvement in mental health system strengthening in a primary healthcare setting in a low-income country. The ToC describes service user and caregiver involvement as a complex intervention and makes explicit the hypothesized pathways through which the intervention components interact to achieve the intended long-term goals of (i) improved physical and mental health, work productivity and social inclusion for service users, and (ii) improved life satisfaction and economic capacity for caregivers. The achievement of these long-term outcomes may ultimately lead to improved quality of life and reduced mortality of service users in the Sodo district. The current study drew upon findings from rigorous formative work with key stakeholders and involved diverse representation of service users, researchers and community groups in the co-produced ToC.

The final ToC consists of four programme levels (community, health organization, service user, and caregiver). This is line with the well documented evidence that determinants of mental health and illness are multi-layered [55] and require intervention packages beyond a health facility (e.g., health system, and community levels) [56,57,58] to address service users’ and caregivers’ multidimensional needs (e.g., health costs, employment, education, housing, social inclusion). Clear articulation and understanding of how different programme levels fit together is essential to guide the coordinated working of multiple actors and agencies and provide a clear picture of what needs to change and how, to achieve sustainable change [59, 60]. For example, district stakeholders identified the availability of rich community resources (also reported in previous study in the district [61]) and multiple actors, particularly at community programme level (e.g., social organizations like Idir) with viable potential to address the psychosocial needs of service users-caregivers locally, with less external support and in a sustainable manner.

In our study, the ToC development process created a forum for knowledge exchange and dialogue among stakeholders about the value of service user involvement, needs, and how to work together to implement this in the local context. The critical reflective discussion with stakeholder groups at Sodo district applied participatory action research (PAR), where participants brainstormed possible solutions to several barriers for effective service user involvement, including the urgency for local solutions (e.g., medication supply challenges, supporting establishment of a service user association). For example, in our separate ToC with professionals (psychiatrists and researchers) and community stakeholders we observed that professionals emphasized long-term outcomes that were more health system focused compared to the community stakeholder groups that tended to emphasize more holistic goals. In the subsequent meeting, the participants discussed this difference of perspective and reached consensus on outcomes that accommodated the perspectives of all participants. Much research evidence indicates that active involvement of stakeholders, including service-users and caregivers, in research ensures that the research evidence is relevant, useful and trusted by all, including the end user (service users) [28, 62, 63]. More importantly, the process created heightened stakeholder buy-in [64], particularly among the political leaders and the community representatives. The ToC process also stimulated collaborative working of stakeholders to empower mental service users-caregivers, which was identified to be starting from a ‘low base’ in the district [47]. ToC approach offers a key contribution to enhance equity and reach of key stakeholders [65], and to incorporate the expertise and knowledge of diverse stakeholder groups` values, needs and preferences. Hence, the ToC development process by itself can be capacity building [66], helping to foster learning and reflection [67], and can facilitate contextualised solutions through a sense of stakeholder ownership of the programme [68,69,70]. Particularly when ToC employs the techniques of participatory action research, it can serve as a catalyst for learning and promote informed action by supporting stakeholders to achieve sustained positive changes in the local context [35, 40, 71].

In our previous qualitative study [54], several structural barriers (e.g., lack of access to care) were identified that serve to disempower people with lived experience of mental health conditions and undermine involvement within healthcare systems. Recently, the Ethiopian government has made a national level commitment to improve the situation of people with mental health conditions through increasing the availability of mental healthcare services at primary healthcare level [49, 72]. Based on our ToC findings, this initiative needs to ensure good quality of care and interventions to address the high levels of physical, emotional and social suffering and disability [73], excess mortality [74], lack of reliable supplies of medication, and low socio-economic status of service users and caregivers (lack of basic needs, shelter, education) [47, 54]. Many studies from LMICs [75, 76] and high-income countries [3, 12, 13] similarly recommend to address and overcome these structural problems, including opportunities to ensure social inclusion and protection of basic human rights (including healthcare) as required conditions to enable mental health service user involvement and recovery to occur.

In many high-income countries, enabling organisational level conditions (e.g., policy directives, legislation, strategies/guidelines, education and support) are available to support meaningful service user and caregiver involvement in mental health systems [1, 28, 77]. In this regard, the promotion of and effective implementation of national and international instruments for the protection of the human rights of service users; and enacting comprehensive mental health legislation with robust enforcement mechanisms are key areas that need attention in LMICs [26, 78], including Ethiopia. The Ethiopian national constitution [79] clearly guarantees the rights of people with disabilities. The country has ratified the United Nations Convention on the Rights of Persons with Disabilities, which includes both physical and mental disabilities [80]; and employment rights [81]. The Health Policy [82], the revision of the National Mental Health Strategy [72] and the Health Sector Transformation Plan [49] also need provisions to explicitly state how service user and caregivers need to be involved within the mental health system.

In our ToC, we identified strengthening local community collaboration to support service user and caregivers as a major intervention component. Previous studies from Sodo district have indicated that there are potentially rich local resources and capabilities (e.g., diverse community based organizations, community based health workers, assets, micro-finance institutions, social capital, community self-support organisations [47, 61]. These resources are not currently mobilized to support mental health service users and caregivers, and there is still limited inter-sectoral collaboration and community awareness about mental illness [47] that may contribute to marginalisation of service users in society. The community level problems require the participation of a range of societal actors [70]; and the need for community collaboration in the provision of comprehensive community mental health services is well recognized, including in LMICs [83, 84]. The current direction of global mental health care emphasizes strengthening community resources, greater focus to address local priorities and developing local assets to solve local problems [7, 85, 86]. One of the mechanisms of community involvement that has been of high policy interest, and is increasingly supported by research evidence, such as engaging local community stakeholders through Health Committees/Community Advisory Boards (CAB) [87,88,89]. CABs mediate between communities and health services in many health systems [87] and can be effective to improve the quality and coverage of healthcare, as well as impacting on health outcomes [2, 88, 90].

A healthcare organization programme level was included in our ToC as a key intervention pathway to empower service users and caregivers to play a role to improve the mental healthcare system. A qualitative study of nine service user and caregiver organizations in seven African countries found that one of the important success factors is strategic government level and health organization support that promotes self-determination and service users’ and caregivers’ control over agenda-setting [91]. There are various ways in which healthcare organizations can create an enabling environment for involvement, including development of a culture of acceptance(non-stigmatizing attitudes and eliminating discriminatory practices); allocation of financial, human and material resources, and recognition of experiential knowledge to strengthen the mental health system [3, 12, 13, 92]. At the health facility level, available up-to-date information about service user rights, the nature of their condition, available evidence-based treatment options and services, and provide infrastructure for involvement can enhance meaningful involvement of service users-caregivers [3, 12, 93].

The service user and caregiver programme level was a key intervention pathway in our ToC to mobilize and empower service users and caregivers for mental health system strengthening. Various barriers hinder service user involvement (e.g., severity of mental and physical illness, lack of decision making skills, poor information and insufficient opportunities for choice) [3, 12, 13, 94]. The pervasive stigma operating within the health system, the local community and individuals, and limited empowerment and mobilization of service users can have disempowering effects on active involvement [54]. Moreover, resource limitations, practical and logistical challenges are important barriers to mental health service user involvement in LMICs which must be addressed [95]. The importance of empowerment of service users and caregivers (at individual and group level) has been recognized widely in mental health system strengthening [12, 13, 94]. At the individual level, empowerment involves addressing both knowledge (e.g. training about effective communication, advocacy, working collaboratively) [12, 13, 31, 96] and health challenges (e.g., medication supply) [12, 13]. Training can improve self-esteem and self-advocacy, assertiveness, confidence and hopefulness of service users and promotes recovery [12, 13, 96]. At the group level, empowerment can be achieved through organization of service users-caregivers.

Several studies identified a range of benefits of service user and caregiver organizations to service users and caregivers, health professionals and health systems. Empowering service users to self-organize and advocate for their interests can promote their recognition of a sense of belonging, and develop their confidence, strengths, resources and skills [26, 91]. This also ensures a collective voice to influence and lobby for policy and legislative reforms [91, 94, 97]. Service user and caregiver associations operate at different levels to protect the rights of service users [76, 91, 98] and there are reports that participation in self-help groups is an independent predictor of improved functioning in areas like voting, marriage, attending festivals, treatment adherence [99], fostering greater acceptance of service users by their family members and by the community, consistent treatment and better outcomes [100]; income generation and quality of life [76]. Self-help groups are important platforms for exchange of individual experiences and mutual support that can lead to better quality of life and insight about how best to cope with their situations [91]. However, there are few service user and caregiver associations in LMICs; for example, in Ethiopia The Mental Service User Association was established in Addis Ababa in 2018, and there is only one association of caregivers at the national level [47].

The ToC workshop and qualitative study participants [54] underlined the importance of capacity building training for service providers/managers and service users-caregivers to enable service user and caregiver involvement. Our finding aligns with Carman et al. [31] who identified the importance of technical support, strong leadership, preparation of service users, health professional and other stakeholders, and partnerships as key facilitators in implementation of multilevel frameworks for service user and caregivers involvement. Various studies also recommend to address the knowledge, attitudes and skills needed for service providers, health administrators at all levels of the healthcare system and service user and caregivers to implement models of service user and caregiver involvement [3, 12, 13, 96]. Participatory action research oriented approaches, such as photovoice, can create longer and repeated opportunities for social contact between service user and caregivers and care providers [101,102,103] and lead to attitudinal change. Photovoice is a multistep participatory action research methodology whereby service users are equipped to represent their stories, including their perceived health and work reality, using photographs, with the goal of impacting an aspect of the system and/or policy [104,105,106].

Strengths and limitations

The participatory ToC development and refinement process brought together diverse stakeholder groups including service users and caregivers to work collaboratively to strengthen service user and caregiver involvement in mental health system, which is a novel approach in LMICs. Their involvement in the ToC development created a sense of ownership and stakeholder buy-in, which is important from the point of view of follow-through on implementation. The overarching goal of this study, was to develop active service user and caregiver involvement in mental health system strengthening. We did not attempt to stratify the ToC process as a mechanism to overcome power imbalance among the multi-stakeholder groups; because the process of bringing diverse stakeholder groups through facilitated interaction can offer better social contact opportunities. Such an approach has been recommended as an effective mechanism to improve attitudes and reduce stigma [107, 108]. Nonetheless, we drew upon the rich experience of the facilitators and their awareness of the potential power difference to intentionally encourage service users, caregiver and other less vocal participants to engage more. The principal facilitator (AF) started the process with a simple and concrete example to explain about ToC to make it understandable for all participants, and to ensure the process achieved its intended goal with the highest possible buy-in from the participants.

Despite this, even with encouragement from the facilitator, the service user participants were not as active as other participants in voicing their views during the ToC workshop. Similar observations have been made previously when developing a participatory mental health care plan in a neighbouring rural Ethiopian district [109]. We were able to draw upon findings from in-depth interviews conducted in the formative phase, which may have helped to mitigate this problem [54]. We don’t think there is a ‘one-size-fits all’ recommendation to make the ToC process more inclusive and overcome the inherent power differentials that could exist in multi-stakeholder discussions. However, we believe that, in addition to the key role of trained and experienced facilitators` efforts to make the process more inclusive, it is helpful to train/equip the participants to engage in discussions and to provide clear initial orientation about the ToC process using local metaphors.

The ToC is mainly based on the views of stakeholders from a limited geographical area of Ethiopia (Sodo district) and may not be transferable to other settings.

Conclusions

The development of ToC and the involvement of diverse community representatives in the process was critical in terms of understanding the context of the programme intervention, to identify components of interventions, and articulate preconditions and underlying assumptions. The participatory approach, systematically applied, gives structure to the identification and articulation of programme theory, an important step of service user involvement in mental health systems strengthening initiatives. This study adds to the limited empirical data on best practices to develop service user and caregiver involvement, particularly in LMICs. The next step will be to pilot and evaluate the model using participatory action research methodology in this rural Ethiopian setting.

Availability of data and materials

Not applicable.

Abbreviations

CAB:

Community Advisory Board

FMOH:

Federal Ministry of Health

HEWs:

Health extension workers

HIC:

High income countries

HSTP:

Health Sector Transformation Plan

LMICs:

Low- and middle-income countries

Emerald:

Emerging mental health systems in low- and middle-income countries

PRIME:

PRogramme for Improving Mental health carE

ToC:

Theory of Change

WHO:

World Health Organization

References

  1. 1.

    Tambuyzer E, Pieters G, Van Audenhove C. Patient involvement in mental health care: one size does not fit all. Health Expect. 2011;17(1):138–50.

    PubMed  PubMed Central  Google Scholar 

  2. 2.

    Wallcraft J, Amering M, Freidin J, Davar B, Froggatt D, Jafri H, et al. Partnerships for better mental health worldwide: WPA recommendations on best practices in working with service users and family carers. World Psychiatry. 2011;10(3):229–36.

    PubMed  PubMed Central  Google Scholar 

  3. 3.

    Bee P, Price O, Baker J, Lovell K. Systematic synthesis of barriers and facilitators to service user-led care planning. Br J Psychiatry. 2015;207(2):104–14.

    PubMed  PubMed Central  Google Scholar 

  4. 4.

    Gallivan J, Kovacs Burns K, Bellows M, Eigenseher C. The many faces of patient engagement. J Participat Med. 2012;4:e32.

    Google Scholar 

  5. 5.

    Millar SL, Chambers M, Giles M. Service user involvement in mental health care: an evolutionary concept analysis. Health Expect. 2016;19(2):209–21.

    PubMed  Google Scholar 

  6. 6.

    Hickey G, Kipping C. Exploring the concept of user involvement in mental health through a participation continuum. J Clin Nurs. 1998;7(1):83–8.

    CAS  PubMed  Google Scholar 

  7. 7.

    World Health Organization. Mental health action plan 2013–2020. Geneva: World Health Organization; 2013. This document was produced in response to the World Health Assembly Resolutions WHA66 8 and WHA65 4, provides the necessary framework for improving mental health globally from the government to individual level, and provides a strong rationale for collaborative care. 2013.

  8. 8.

    Saxena S, Funk M, Chisholm D. World health assembly adopts comprehensive mental health action plan 2013–2020. Lancet. 2013;381(9882):1970–1.

    PubMed  Google Scholar 

  9. 9.

    Lloyd M. Participation in practice a review of service user involvement in mental health nursing. Ment Health Learn Disabil Res Pract. 2010;7(2):195–206.

    Google Scholar 

  10. 10.

    Simpson EL, House AO. Involving users in the delivery and evaluation of mental health services: systematic review. Br J Psychiatry. 2002;325(7375):1265.

    Google Scholar 

  11. 11.

    Crawford MJ, Rutter D, Manley C, Weaver T, Bhui K, Fulop N, et al. Systematic review of involving patients in the planning and development of health care. BMJ. 2002;325(7375):1263.

    PubMed  PubMed Central  Google Scholar 

  12. 12.

    McDaid S. An equality of condition framework for user involvement in mental health policy and planning: evidence from participatory action research. Disabil Soc. 2009;24(4):461–74.

    Google Scholar 

  13. 13.

    Linhorst DM. Empowering people with severe mental illness: a practical guide. Oxford: Oxford University Press; 2006.

    Google Scholar 

  14. 14.

    Saraceno B, van Ommeren M, Batniji R, Cohen A, Gureje O, Mahoney J, et al. Barriers to improvement of mental health services in low-income and middle-income countries. Lancet. 2007;370(9593):1164–74.

    PubMed  Google Scholar 

  15. 15.

    Ventevogel P. Integration of mental health into primary healthcare in low-income countries: avoiding medicalization. Int Rev Psychiatry. 2014;26(6):669–79.

    PubMed  Google Scholar 

  16. 16.

    Eaton J, McCay L, Semrau M, Chatterjee S, Baingana F, Araya R, et al. Scale up of services for mental health in low-income and middle-income countries. Lancet. 2011;378(9802):1592–603.

    PubMed  Google Scholar 

  17. 17.

    Patel V, Bloch S. The ethical imperative to scale up health care services for people with severe mental disorders in low and middle income countries. Postgrad Med J. 2009;85(1008):509–13.

    CAS  PubMed  Google Scholar 

  18. 18.

    Patel V, Maj M, Flisher AJ, De Silva MJ, Koschorke M, Prince M, et al. Reducing the treatment gap for mental disorders: a WPA survey. World Psychiatry. 2010;9(3):169–76.

    PubMed  PubMed Central  Google Scholar 

  19. 19.

    Alloh FT, Regmi P, Onche I, Van Teijlingen E, Trenoweth S. Mental Health in low-and middle income countries (LMICs): going beyond the need for funding. Health Prospect: J Public Health. 2018;17(1):12–7.

    Google Scholar 

  20. 20.

    Rathod S, Pinninti N, Irfan M, Gorczynski P, Rathod P, Gega L, et al. Mental health service provision in low-and middle-income countries. Health Serv Insights. 2017;10:1178632917694350.

    PubMed  PubMed Central  Google Scholar 

  21. 21.

    Semrau M, Evans-Lacko S, Koschorke M, Ashenafi L, Thornicroft G. Stigma and discrimination related to mental illness in low-and middle-income countries. Epidemiol Psychiatr Sci. 2015;24(5):382–94.

    CAS  PubMed  Google Scholar 

  22. 22.

    Heim E, Kohrt B, Koschorke M, Milenova M, Thronicroft G. Reducing mental health-related stigma in primary health care settings in low-and middle-income countries: a systematic review. Epidemiol Psychiatr Sci. 2018;29:1–10.

    Google Scholar 

  23. 23.

    Whiteford HA, Degenhardt L, Rehm J, Baxter AJ, Ferrari AJ, Erskine HE, et al. Global burden of disease attributable to mental and substance use disorders: findings from the Global Burden of Disease Study 2010. Lancet. 2013;382(9904):1575–86.

    PubMed  Google Scholar 

  24. 24.

    Fekadu A, Medhin G, Kebede D, Alem A, Cleare AJ, Prince M, et al. Excess mortality in severe mental illness: 10-year population-based cohort study in rural Ethiopia. Br J Psychiatry. 2015;206(4):289–96.

    PubMed  Google Scholar 

  25. 25.

    Liu NH, Daumit GL, Dua T, Aquila R, Charlson F, Cuijpers P, et al. Excess mortality in persons with severe mental disorders: a multilevel intervention framework and priorities for clinical practice, policy and research agendas. World Psychiatry. 2017;16(1):30–40.

    PubMed  PubMed Central  Google Scholar 

  26. 26.

    Drew N, Funk M, Tang S, Lamichhane J, Chávez E, Katontoka S, et al. Human rights violations of people with mental and psychosocial disabilities: an unresolved global crisis. Lancet. 2011;378(9803):1664–75.

    PubMed  Google Scholar 

  27. 27.

    Asher L, Fekadu A, Teferra S, Silva M, Pathare S, Hanlon C. “I cry every day and night, I have my son tied in chains”: physical restraint of people with schizophrenia in community settings in Ethiopia. Glob Health. 2017;13(1):47.

    Google Scholar 

  28. 28.

    Carman KL, Dardess P, Maurer M, Sofaer S, Adams K, Bechtel C, et al. Patient and family engagement: a framework for understanding the elements and developing interventions and policies. Health Aff. 2013;32(2):223–31.

    Google Scholar 

  29. 29.

    Pomey M-P, Morin E, Neault C, Biron V, Houle L, Lavigueur L, et al. Patient Advisors: how to implement a process for involvement at all levels of governance in a healthcare organization. Patient Exp J. 2016;3(2):99–112.

    Google Scholar 

  30. 30.

    Semrau M, Lempp H, Keynejad R, Evans-Lacko S, Mugisha J, Raja S, et al. Service user and caregiver involvement in mental health system strengthening in low-and middle-income countries: systematic review. BMC Health Serv Res. 2016;16(1):79.

    PubMed  PubMed Central  Google Scholar 

  31. 31.

    Carman KL, Workman TA. Engaging patients and consumers in research evidence: applying the conceptual model of patient and family engagement. Patient Educ Couns. 2017;100(1):25–9.

    PubMed  Google Scholar 

  32. 32.

    Moore G, Audrey S, Barker M, Bond L, Bonell C, Hardeman W. Process evaluation of complex interventions. UK Medical Research Council (MRC) Guidance. 2014. http://www.populationhealthsciences.org/MRC-PHSRN-Process-evaluation-guidance-final-2-pdf. Accessed 31 July 2015. [WebCite Cache ID 6aR8BKLsy]. 2015.

  33. 33.

    De Silva MJ, Breuer E, Lee L, Asher L, Chowdhary N, Lund C, et al. Theory of Change: a theory-driven approach to enhance the Medical Research Council’s framework for complex interventions. Trials. 2014;15(1):267.

    PubMed  PubMed Central  Google Scholar 

  34. 34.

    Breuer E, Lee L, De Silva M, Lund C. Using theory of change to design and evaluate public health interventions: a systematic review. Implement Sci. 2016;11(1):63.

    PubMed  PubMed Central  Google Scholar 

  35. 35.

    James C. Theory of change review. A report commissioned by Comic Relief, London. 2011.

  36. 36.

    Hanlon C, Fekadu A, Jordans M, Kigozi F, Petersen I, Shidhaye R, et al. District mental healthcare plans for five low-and middle-income countries: commonalities, variations and evidence gaps. Br J Psychiatry. 2015;208.

  37. 37.

    Asher L, Hanlon C, Birhane R, Habtamu A, Eaton J, Weiss HA, et al. Community-based rehabilitation intervention for people with schizophrenia in Ethiopia (RISE): a 12 month mixed methods pilot study. BMC Psychiatry. 2018;18(1):250.

    PubMed  PubMed Central  Google Scholar 

  38. 38.

    Weiss CH. Nothing as practical as good theory: exploring theory-based evaluation for comprehensive community initiatives for children and families. New approaches to evaluating community initiatives: concepts, methods, and contexts. New Approaches Eval Community Initiat Concepts. 1995;1:65–92.

    Google Scholar 

  39. 39.

    Chen HT. Practical program evaluation: theory-driven evaluation and the integrated evaluation perspective. London: Sage Publications; 2014.

    Google Scholar 

  40. 40.

    Montague S. Does your implementation fit your theory of change? Can J Program Eval. 2019;33(3):316–35.

    Google Scholar 

  41. 41.

    Arensman B, Van Waegeningh C, Van Wessel M. Twinning, “practices of change” with “theory of change” room for emergence in advocacy evaluation. Am J Eval. 2018;39(2):221–36.

    PubMed  Google Scholar 

  42. 42.

    Semrau M, Evans-Lacko S, Alem A, Ayuso-Mateos JL, Chisholm D, Gureje O, et al. Strengthening mental health systems in low-and middle-income countries: the Emerald programme. BMC Med. 2015;13(1):79.

    PubMed  PubMed Central  Google Scholar 

  43. 43.

    Emerald. Emerald: Emerging mental health systems in low- and middle-income countries. https://www.emerald-project.eu.

  44. 44.

    Lund C, Tomlinson M, De Silva M, Fekadu A, Shidhaye R, Jordans M, et al. PRIME: a programme to reduce the treatment gap for mental disorders in five low-and middle-income countries. PLoS Med. 2012;9(12):e1001359.

    PubMed  PubMed Central  Google Scholar 

  45. 45.

    Fekadu A, Hanlon C, Medhin G, Alem A, Selamu M, Giorgis TW, et al. Development of a scalable mental healthcare plan for a rural district in Ethiopia. Br J Psychiatry. 2015;1:s9.

    Google Scholar 

  46. 46.

    CSA. Summary and statistical report of the 2007 population and housing census: Federal Democratic Republic of Ethiopia Population census commission. Addis Ababa: CSA; 2008.

    Google Scholar 

  47. 47.

    Hanlon C, Luitel NP, Kathree T, Murhar V, Shrivasta S, Medhin G, et al. Challenges and opportunities for implementing integrated mental health care: a district level situation analysis from five low-and middle-income countries. PLoS ONE. 2014;9(2):e88437.

    PubMed  PubMed Central  Google Scholar 

  48. 48.

    Keynejad RC, Dua T, Barbui C, Thornicroft G. WHO Mental Health Gap Action Programme (mhGAP) Intervention Guide: a systematic review of evidence from low and middle-income countries. Evid Based Ment Health. 2018;21(1):30–4.

    PubMed  Google Scholar 

  49. 49.

    Federal Ministry of Health. HSTP: Health Sector Transformation Plan—2015/16–2019/20(2008–2012 EFY). Addis Ababa: Federal Democratic Republic of Ethiopia; Ministry of Health; 2015.

    Google Scholar 

  50. 50.

    Wang H, Tesfaye R, Ramana GN, Chekagn CT. Ethiopia health extension program: an institutionalized community approach for universal health coverage. Washington DC: World Bank Publications; 2016.

    Google Scholar 

  51. 51.

    Hailemariam M, Fekadu A, Prince M, Hanlon C. Engaging and staying engaged: a phenomenological study of barriers to equitable access to mental healthcare for people with severe mental disorders in a rural African setting. Int J Equity Health. 2017;16(1):156.

    PubMed  PubMed Central  Google Scholar 

  52. 52.

    Fekadu A, Hanlon C, Medhin G, Alem A, Selamu M, Giorgis TW, et al. Development of a scalable mental healthcare plan for a rural district in Ethiopia. Br J Psychiatry. 2016;208(s56):s4–12.

    PubMed  PubMed Central  Google Scholar 

  53. 53.

    Ritchie J, Lewis J, Nicholls CM, Ormston R. Qualitative research practice: a guide for social science students and researchers. London: Sage Publications; 2013.

    Google Scholar 

  54. 54.

    Abayneh S, Lempp H, Alem A, Alemayehu D, Eshetu T, Lund C, et al. Service user involvement in mental health system strengthening in a rural African setting: qualitative study. BMC Psychiatry. 2017;17(1):187.

    PubMed  PubMed Central  Google Scholar 

  55. 55.

    Eriksson M, Ghazinour M, Hammarström A. Different uses of Bronfenbrenner’s ecological theory in public mental health research: what is their value for guiding public mental health policy and practice? Soc Theory Health. 2018;16(4):414–33.

    Google Scholar 

  56. 56.

    Pope MA, Malla AK, Iyer SN. Who should be responsible for supporting individuals with mental health problems? A critical literature review. Int J Soc Psychiatry. 2018;64:293–302.

    PubMed  Google Scholar 

  57. 57.

    George AS, Scott K, Mehra V, Sriram V. Synergies, strengths and challenges: findings on community capability from a systematic health systems research literature review. BMC Health Serv Res. 2016;16(7):623.

    PubMed  Google Scholar 

  58. 58.

    Asher L, Patel V, De Silva MJ. Community-based psychosocial interventions for people with schizophrenia in low and middle-income countries: systematic review and meta-analysis. BMC Psychiatry. 2017;17(1):355.

    PubMed  PubMed Central  Google Scholar 

  59. 59.

    Bilodeau A, Galarneau M, Lefebvre C, Potvin L. Linking process and effects of intersectoral action on local neighbourhoods: systemic modelling based on Actor-Network Theory. Sociol Health Illn. 2019;41(1):165–79.

    PubMed  Google Scholar 

  60. 60.

    Koleros A, Mulkerne S, Oldenbeuving M, Stein D. The actor-based change framework: a pragmatic approach to developing program theory for interventions in complex systems. Am J Eval. 2018;41(1):34–53.

    Google Scholar 

  61. 61.

    Selamu M, Asher L, Hanlon C, Medhin G, Hailemariam M, Patel V, et al. Beyond the biomedical: community resources for mental health care in rural Ethiopia. PLoS ONE. 2015;10(5):e0126666.

    PubMed  PubMed Central  Google Scholar 

  62. 62.

    Brett J, Staniszewska S, Mockford C, Herron-Marx S, Hughes J, Tysall C, et al. Mapping the impact of patient and public involvement on health and social care research: a systematic review. Health Expect. 2014;17(5):637–50.

    PubMed  Google Scholar 

  63. 63.

    Concannon TW, Fuster M, Saunders T, Patel K, Wong JB, Leslie LK, et al. A systematic review of stakeholder engagement in comparative effectiveness and patient-centered outcomes research. J Gen Intern Med. 2014;29(12):1692–701.

    PubMed  PubMed Central  Google Scholar 

  64. 64.

    Patton MQ. Developmental evaluation: applying complexity concepts to enhance innovation and use. New York: Guilford Press; 2011.

    Google Scholar 

  65. 65.

    Montague S, Porteous NL. The case for including reach as a key element of program theory. Evaluation and Program Planning. 2013;36(1):177–83.

    PubMed  Google Scholar 

  66. 66.

    Weiss CH. Theory-based evaluation: past, present, and future. New Direct Eval. 1997;1997(76):41–55.

    Google Scholar 

  67. 67.

    Valters C. Theories of change in international development: Communication, learning, or accountability. JSRP Paper. 2014;17.

  68. 68.

    Breuer E, De Silva MJ, Fekadu A, Luitel NP, Murhar V, Nakku J, et al. Using workshops to develop theories of change in five low and middle income countries: lessons from the programme for improving mental health care (PRIME). Int J Ment Health Syst. 2014;8(1):15.

    PubMed  PubMed Central  Google Scholar 

  69. 69.

    Blamey A, Mackenzie M. Theories of change and realistic evaluation: peas in a pod or apples and oranges? Evaluation. 2007;13(4):439–55.

    Google Scholar 

  70. 70.

    van Tulder R, Keen N. Capturing collaborative challenges: designing complexity-sensitive theories of change for cross-sector partnerships. J Bus Ethics. 2018;150(2):315–32.

    PubMed  PubMed Central  Google Scholar 

  71. 71.

    Wicks PG, Reason P. Initiating action research: challenges and paradoxes of opening communicative space. London: Sage Publications; 2009.

    Google Scholar 

  72. 72.

    Federal Ministry of Health. National Mental Health Strategy, 2012/13–2015/16. Addis Ababa: Federal Democratic Republic of Ethiopia; Ministry of Health; 2012.

    Google Scholar 

  73. 73.

    Shibre T, Medhin G, Alem A, Kebede D, Teferra S, Jacobsson L, et al. Long-term clinical course and outcome of schizophrenia in rural Ethiopia: 10-year follow-up of a population-based cohort. Schizophr Res. 2015;161(2):414–20.

    PubMed  Google Scholar 

  74. 74.

    Fekadu A, Medhin G, Kebede D, Alem A, Cleare AJ, Prince M, et al. Excess mortality in severe mental illness: 10-year population-based cohort study in rural Ethiopia. Br J Psychiatry. 2015;206:289–96.

    PubMed  Google Scholar 

  75. 75.

    Raja S, Underhill C, Shrestha P, Sunder U, Mannarath S, Wood SK, et al. Integrating mental health and development: a case study of the BasicNeeds Model in Nepal. PLoS Med. 2012;9(7):e1001261.

    PubMed  PubMed Central  Google Scholar 

  76. 76.

    Lund C, Waruguru M, Kingori J, Kippen-Wood S, Breuer E, Mannarath S, et al. Outcomes of the mental health and development model in rural Kenya: a 2-year prospective cohort intervention study. Int Health. 2013;5(1):43–50.

    PubMed  Google Scholar 

  77. 77.

    Tritter JQ, McCallum A. The snakes and ladders of user involvement: moving beyond Arnstein. Health Policy. 2006;76(2):156–68.

    PubMed  Google Scholar 

  78. 78.

    World Health Organization. Mental health atlas: Ethiopia. Geneva: WHO; 2011.

    Google Scholar 

  79. 79.

    Federal Democratic Republic of Ethiopia. The constitution of the federal democratic republic of Ethiopia. Ethiopia: Addis Ababa; 1995.

    Google Scholar 

  80. 80.

    Federal Democratic Republic of Ethiopia. Ratification Proclamation to the United Nation Convention on the rights of persons with disabilities, Proclamation no. 676/2010. Addis Ababa, Ethiopia 2010.

  81. 81.

    Federal Democratic Republic of Ethiopia. A proclamation to provide for the right to employment of persons with disability: proclamation No. 568/2008. Addis Ababa, Ethiopia 2008.

  82. 82.

    Federal Ministry of Health. Health policy of the Transitional government of Ethiopia. Addis Ababa: Federal Minstry of Health; 1993.

    Google Scholar 

  83. 83.

    Thornicroft G, Alem A, Santos RA, Barley E, Drake RE, Gregorio G, et al. WPA guidance on steps, obstacles and mistakes to avoid in the implementation of community mental health care. World Psychiatry. 2010;9(2):67–77.

    PubMed  PubMed Central  Google Scholar 

  84. 84.

    Petersen I, Lund C, Stein DJ. Optimizing mental health services in low-income and middle-income countries. Current Opinion in Psychiatry. 2011;24(4):318–23.

    PubMed  Google Scholar 

  85. 85.

    Kirmayer LJ, Pedersen D. Toward a new architecture for global mental health. London: Sage Publications; 2014.

    Google Scholar 

  86. 86.

    Patel V, Saxena S. Transforming lives, enhancing communities—innovations in global mental health. N Engl J Med. 2014;370(6):498–501.

    CAS  PubMed  Google Scholar 

  87. 87.

    George A, Scott K, Garimella S, Mondal S, Ved R, Sheikh K. Anchoring contextual analysis in health policy and systems research: a narrative review of contextual factors influencing health committees in low and middle income countries. Soc Sci Med. 2015;133:159–67.

    PubMed  Google Scholar 

  88. 88.

    McCoy DC, Hall JA, Ridge M. A systematic review of the literature for evidence on health facility committees in low-and middle-income countries. Health Policy Plann. 2011;27(6):449–66.

    Google Scholar 

  89. 89.

    Lodenstein E, Mafuta E, Kpatchavi AC, Servais J, Dieleman M, Broerse JE, et al. Social accountability in primary health care in West and Central Africa: exploring the role of health facility committees. BMC Health Serv Res. 2017;17(1):403.

    PubMed  PubMed Central  Google Scholar 

  90. 90.

    Hanlon C, Wondimagegn D, Alem A. Lessons learned in developing community mental health care in Africa. World Psychiatry. 2010;9(3):185–9.

    PubMed  PubMed Central  Google Scholar 

  91. 91.

    Kleintjes S, Lund C, Swartz L. Organising for self-advocacy in mental health: experiences from seven African countries. Afr J Psychiatry. 2013;16(3):187–95.

    CAS  Google Scholar 

  92. 92.

    Scholz B, Gordon S, Happell B. Consumers in mental health service leadership: a systematic review. Int J Ment Health Nurs. 2017;26(1):20–31.

    PubMed  Google Scholar 

  93. 93.

    Linhorst DM, Eckert A. Conditions for empowering people with severe mental illness. Social Serv Rev. 2003;77(2):279–305.

    Google Scholar 

  94. 94.

    Scholz B, Gordon S, Happell B. Consumers in mental health service leadership: a systematic review. Int J Ment Health Nurs. 2016;26:20–31.

    PubMed  Google Scholar 

  95. 95.

    Ryan GK, Semrau M, Nkurunungi E, Mpango RS. Service user involvement in global mental health: what have we learned from recent research in low and middle-income countries? Curr opin Psychiatry. 2019;32:355–60.

    PubMed  Google Scholar 

  96. 96.

    Nieminen I, Kylmä J, Åstedt-Kurki P, Kulmala A, Kaunonen M. Mental health service users’ experiences of training focused on empowerment: training environment and the benefits of training. Arch Psychiatr Nurs. 2016;30(3):309–15.

    PubMed  Google Scholar 

  97. 97.

    Burns JK. Mental health and inequity: a human rights approach to inequality, discrimination, and mental disability. Health Hum Rights. 2009;1:19–31.

    Google Scholar 

  98. 98.

    BasicNeeds. Community mental health practice: seven essential features for scaling up in low-and middle-income countries. Basic Needs. 2009.

  99. 99.

    Chatterjee S, Pillai A, Jain S, Cohen A, Patel V. Outcomes of people with psychotic disorders in a community-based rehabilitation programme in rural India. Br J Psychiatry. 2009;195(5):433–9.

    PubMed  PubMed Central  Google Scholar 

  100. 100.

    Cohen A, Raja S, Underhill C, Yaro BP, Dokurugu AY, De Silva M, et al. Sitting with others: mental health self-help groups in northern Ghana. Int J Ment Health Syst. 2012;6(1):1.

    PubMed  PubMed Central  Google Scholar 

  101. 101.

    Knaak S, Modgill G, Patten SB. Key ingredients of anti-stigma programs for health care providers: a data synthesis of evaluative studies. Can J Psychiatry. 2014;59(1):19–26.

    Google Scholar 

  102. 102.

    Pettigrew TF, Tropp LR. A meta-analytic test of intergroup contact theory. J Pers Soc Psychol. 2006;90(5):751.

    PubMed  Google Scholar 

  103. 103.

    Hewstone M, Swart H. Fifty-odd years of inter-group contact: from hypothesis to integrated theory. Br J Soc Psychol. 2011;50(3):374–86.

    PubMed  Google Scholar 

  104. 104.

    Becker K, Reiser M, Lambert S, Covello C. Photovoice: conducting community-based participatory research and advocacy in mental health. J Creat Ment Health. 2014;9(2):188–209.

    Google Scholar 

  105. 105.

    Russinova Z, Mizock L, Bloch P. Photovoice as a tool to understand the experience of stigma among individuals with serious mental illnesses. Stigma Health. 2018;3(3):171.

    Google Scholar 

  106. 106.

    Tang JPS, Tse S, Davidson L. The big picture unfolds: using photovoice to study user participation in mental health services. Int J Soc Psychiatry. 2016;62(8):696–707.

    PubMed  Google Scholar 

  107. 107.

    Maunder RD, White FA. Intergroup contact and mental health stigma: a comparative effectiveness meta-analysis. Clin Psychol Rev. 2019;72:101749.

    PubMed  Google Scholar 

  108. 108.

    Evans-Lacko S, London J, Japhet S, Rüsch N, Flach C, Corker E, et al. Mass social contact interventions and their effect on mental health related stigma and intended discrimination. BMC Public Health. 2012;12(1):489.

    PubMed  PubMed Central  Google Scholar 

  109. 109.

    Mayston R, Alem A, Habtamu A, Shibre T, Fekadu A, Hanlon C. Participatory planning of a primary care service for people with severe mental disorders in rural Ethiopia. Health Policy Plann. 2015;31(3):367–76.

    Google Scholar 

  110. 110.

    Hailemariam M, Fekadu A, Selamu M, Alem A, Medhin G, Giorgis TW, et al. Developing a mental health care plan in a low resource setting: the theory of change approach. BMC Health Serv Res. 2015;15(1):429.

    PubMed  PubMed Central  Google Scholar 

  111. 111.

    Lempp H, Abayneh S, Gurung D, Kola L, Abdulmalik J, Evans-Lacko S, et al. Service user and caregiver involvement in mental health system strengthening in low-and middle-income countries: a cross-country qualitative study. Epidemiol Psychiatr Sci. 2017;27:29–39.

    PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

We would like to acknowledge the financial support from the Psychiatry Research Trust and the PRIME project, Ethiopia. PRIME was funded by the UK Department for International Development (DfID) [201446]. Funding was also received from Addis Ababa University. The authors acknowledge the contributions of all stakeholder groups participated in the ToC workshops. We would like to thank Sodo district health office and PRIME project field coordinators who invested their time and effort in facilitating the workshops.

Funding

The district level ToC workshop on this manuscript was financially supported by the Psychiatry Research Trust and the PRIME project, Ethiopia. PRIME was funded by the UK Department for International Development (DfID) [201446]. The views expressed in this article do not necessarily reflect the UK Government’s official policies. Funding was also received from Addis Ababa University. None of the funding bodies had a role in study design, data collection and analysis, decision to publish or preparation of the manuscript. BAK is supported by the United States National Institute of Mental Health and Fogarty International Center (Grant No. R21MH111280). CH is supported by the National Institute of Health Research (NIHR) Global Health Research Unit on Health System Strengthening in Sub-Saharan Africa, King’s College London (GHRU 16/136/54) using UK aid from the UK Government. CH additionally receives support from the Wellcome Trust-funded Africa Mental Health Research Initiative (AMARI) as part of the DELTAS Africa Initiative [DEL-15-01]The views expressed are those of the author and not necessarily those of the NIHR or the Department of Health and Social Care.

Author information

Affiliations

  1. Department of Psychiatry, School of Medicine, College of Health Sciences, Addis Ababa University, WHO Collaborating Centre in Mental Health Research and Capacity Building, Addis Ababa, Ethiopia

    Sisay Abayneh, Atalay Alem, Abebaw Fekadu & Charlotte Hanlon

  2. Faculty of Life Sciences and Medicine, Centre for Rheumatic Diseases, School of Immunology and Microbial Sciences, King’s College London, Weston Education Centre 10, Cutcombe Rd, London, SE5 9RJ, UK

    Heidi Lempp

  3. Department of Psychiatry, George Washington University, Washington, DC, USA

    Brandon A. Kohrt

  4. College of Health Sciences, Centre for Innovative Drug Development and Therapeutic Trials for Africa (CDT-Africa), Addis Ababa University, Addis Ababa, Ethiopia

    Abebaw Fekadu & Charlotte Hanlon

  5. Department of Global Health & Infection, Brighton and Sussex Medical School, Brighton, UK

    Abebaw Fekadu

  6. Centre for Global Mental Health, Institute of Psychiatry, Psychology and Neuroscience, King’s College London, 16 De Crespigny Park, London, SE5 8AF, UK

    Charlotte Hanlon

Authors
  1. Sisay Abayneh
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Heidi Lempp
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Atalay Alem
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Brandon A. Kohrt
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Abebaw Fekadu
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Charlotte Hanlon
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

SA led the study, darted and revised the manuscript with supervision from CH and HL. SA, CH, AA, and AF were team that runs the ToC workshop. CH, HL, AA, BK, and AF edited the paper. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Sisay Abayneh.

Ethics declarations

Ethics approval and consent to participate

Ethical approval was obtained from the Institutional Review Board of Addis Ababa University College of Health Sciences (Protocol number: 027/16/Psy). The participants in the first workshop were part of the research team and their consent was assured by virtue of them being part of the research team. All participants involved in the stakeholder group meeting at Sodo district were provided with written information and provided informed consent to participate in the study prior to the workshop.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Abayneh, S., Lempp, H., Alem, A. et al. Developing a Theory of Change model of service user and caregiver involvement in mental health system strengthening in primary health care in rural Ethiopia. Int J Ment Health Syst 14, 51 (2020). https://doi.org/10.1186/s13033-020-00383-6

Download citation

Keywords

  • Theory of Change
  • Service user involvement
  • Caregiver involvement
  • Mental health system
  • Rural
  • Ethiopia

International Journal of Mental Health Systems

ISSN: 1752-4458