Evaluation of outcomes for psychosis and epilepsy treatment delivered by primary health care workers in Nepal: a cohort study

Abstract

Background

Most evaluations of task-shifting have focused on common mental disorders. Much less work has been done on severe mental neurological and substance use (MNS) disorders, such as chronic psychosis and epilepsy. Given the high burden associated with severe MNS and the lack of mental health professionals in low and middle income countries, evaluations on the impact of task-shifting for these disorders are important.

Methods

In a rural district of Nepal, a community mental health program, based on World Health Organization’s Mental Health Gap Action Programme guidelines, was evaluated using a cohort study design. People with epilepsy and psychotic disorders were interviewed at treatment initiation and at 12-month follow-up. We also compared a group that was offered a comprehensive package of care (medication combined with psychosocial interventions, such as counselling and peer support groups) to a group that received medication only.

Results

One-hundred nineteen persons were enrolled in the epilepsy cohort (EC) and 85 in the psychosis cohort (PC). The patients were enrolled in either the comprehensive package (n = 157) or medication only (n = 47). There was significant improvement (P < 0.0001) in psychosis symptoms (PC: Z = 6.78, r = 0.80) and depressive symptoms (EC: Z = 7.43, r = 0.73; PC: Z = 6.02, r = 0.70), seizures (EC: Z = 6.78), functional disability (EC: Z = 6.38, r = 0.67; PC: Z = 4.60, r = 0.57), family and caregiver burden (EC: Z = 8.09, r = 0.85; PC: Z = 6.81, r = 0.84), and social behaviour (PC: Z = 5.94, r = 0.84). There was greater risk reduction for recent seizures among people with epilepsy in the comprehensive treatment package vs. medication only (risk ratio = 0.52, 95% CI 0.29–0.95; P = 0.03); no other significant differences were observed between treatment arms.

Conclusions

A community mental health program in Nepal, implemented by non-specialists, resulted in moderate to large effects among people with epilepsy or psychosis. A comprehensive package of care, including counselling and patient support groups, appears to offer added clinical benefits for patients with epilepsy. For people with psychosis, the basic package of care (i.e., psychotropic medications) performed similar to the comprehensive package, suggesting a less resource-intensive package may offer comparable results.

Background

In most low- and middle income countries (LMIC) decentralized mental health services often range from inadequate to nonexistent [1], which is particularly concerning in light of the high burden of disease associated with mental illness globally [2]. Prior research has demonstrated high levels of common mental disorders in rural Nepal [3, 4], and a treatment gap (i.e. the percentage of people with mental illness that are not receiving adequate services) between 94.9 and 91.9 for alcohol use disorder and depression, respectively (Luitel et al., under review). Similar data on severe mental, neurological and substance use (MNS) disorders are lacking for Nepal. The integration of mental health services within primary health care has long been advocated as a strategy to reduce the treatment gap, most recently through a set of clinical guidelines for health workers [5].

Consistent with this approach, the Mental Health Beyond Facilities (mhBeF) project aimed to establish a community-based mental health care program designed to reduce the treatment gap and relieve the clinical and social burden of severe MNS disorders for patients and their families. Patients enrolled in mhBeF receive a Mental Health Care Package (MHCP) developed in accordance with the World Health Organization’s (WHO) Mental Health Gap Action Programme (mhGAP; [6]), which relies on non-specialist health workers in primary care centers as the focal point for the detection and treatment of mental disorders. The MHCP integrates both mental health services into primary health care, which pivots from a facility-based to a community-centric model of treatment, and is comprised of (i) strengthening clinical recognition, referral, assessment and management by non-specialist health care workers and (ii) community level activities such as case detection, family counselling and patient support groups (PSGs).

The present study evaluates the outcomes of a treatment package for a cohort of patients with two MNS disorders, either psychosis or epilepsy, in rural Nepal. The primary objective is to evaluate the clinical and functional outcomes of the full cohort after 12 months of treatment. The secondary objective is to assess the added value of a comprehensive package of services over a minimal package of services. Ultimately the study aims to establish an evidence base for the viability of using this treatment model in Nepal and the potential for assimilation into the Nepal healthcare system at scale.

Methods

Setting

The mhBeF program in Nepal was implemented in Pyuthan district between 2013 and 2015. Pyuthan is a district located in the mid hills of the Rapti zone in the mid-western development region of Nepal. Nepal ranks 145 of 187 countries on the human development index (HDI) in 2015. The objective of mhBeF was to develop and implement a comprehensive community-based mental health care plan, in accordance with the mhGAP guidelines, for persons with severe mental disorders (psychosis and bipolar disorder) and epilepsy in Liberia, Uganda, and Nepal [7].

Intervention arms

The study evaluated patients that were offered a comprehensive care package, which included; (a) clinical assessment and psychotropic treatment by primary health care (PHC) workers following the mhGAP Intervention Guide (after receiving a 9-day training); (b) psychosocial support through individual or family counselling and patient support groups (PSGs) by community counsellors (after receiving a 21-day training, in addition to a base training in counselling); and (c) conducting stigma reduction activities and ensuring follow-up care through home-based care by female community health volunteers (after receiving a 3-day training). Supervision of PHC workers by a psychiatrist was an integral component of the program. In addition the program used a newly developed procedure (Community Informant Detection Tool—CIDT) for pro-active case finding by community members to increase demand for mental health services. The CIDT has been developed in Nepal, and evaluated for accuracy [8] and impact on increased help seeking [9]. One group of the study participants was offered this comprehensive package of care, while a comparison group was offered a more basic set of services consisting only psychotropic medicines (enhanced Treatment As Usual, eTAU) by mhGAP trained health workers, to allow the assessment of the added value of a comprehensive package of services over a minimal package of services. While the program planned to cater for people with psychosis, epilepsy and bipolar disorder, during the implementation phase only 6 people with bipolar were identified and treated. These people have been excluded from the study. Allocation to treatment or control arms was done by health facilities, which were geographically separated to minimize contamination. In the treatment arm we included the health facilities of 12 Village Development Committees (VDC; the smallest administrative unit in Nepal), and health facilities of 5 VDCs were included in the control arm. We first listed all eligible VDCs within the district (excluding those where referral and supervision were not going to be feasible). Next, we separated the health facilities (n = 5) that had received some form of prior mental health training (which was less than the training that was given as part of this study) from those that had never received such training. The former were allocated to the eTAU arm. Among the latter we randomly selected 12 health facilities—the number was set by the maximum capacity for project implementation.

Sample

Patients with a primary diagnosis of psychosis or epilepsy established by PHC workers trained in mhGAP were recruited into a controlled cohort study. Inclusion into the study followed a three-staged process. First potential respondents were identified as possibly having one of the target disorders (i.e. psychoses and epilepsy) using the CIDT—as described above. Second, all identified individuals were screened using a brief screening instrument developed for the purpose. Third, if a person is found positive on one or more of the target disorders based on the screening procedure, he or she was assessed by trained PHC workers following the mhGAP guidelines for on the target disorders.

Procedures

All research assistants were selected from Pyuthan district and received a 3-week training. The training included basic communication and interviewing skills, research concepts and ethics, as well supervised practice of administering the surveys. Written consent was sought from all respondents, after a full explanation of the study. All individuals that were diagnosed and provided informed consent, baseline measurement was administered by research assistants. Recruitment took place between June 2014 and May 2015. Ethical approval for this study was obtained from the Nepal Health Research Council (NHRC) (Ref: 874; Reg 173/2013). Adverse events were monitored and responded to following TPO Nepal’s Adverse Events Reporting Procedure.

Measures

We selected a clinically-appropriate measure to assess symptom reduction for each disorder [1] Psychosis symptoms: people with psychosis completed the positive and negative symptoms scale (PANSS) (10), which has previously been validated in South Asia [11]. For this study we did not use the PANSS general scale, but only the positive and negative symptoms sub-scales (and for analyses combined positive and negative symptoms sub-scales) [2]. Depression symptoms: all participants also completed the Hamilton Depression Scale (HAM-D; [12]), which we included due to the increased risk of depression among people with epilepsy and psychosis [3]. Seizures: For people with epilepsy, a 9-item instrument to measure the number epileptic seizures in the previous 3 months (i.e., recent seizure) was used [13], which was scored dichotomously [4]. Disability: we measured functional disability for all patients through the 12-item version of the WHO Disability Assessment Schedule 2.0 (WHODAS). The WHODAS has been used extensively and validated in many low- and middle-income countries [14], including in Nepal [15]. We used the complex scoring method when calculating patients’ scores, which incorporates item weights [5]. Burden associated with mental illness, an important impact factor for caregivers and families of those with severe disorders, was measured through the burden assessment schedule (BAS; [16]) and two sections of the family interview schedule (FIS; [17]): symptoms and social behavior (FIS-SSB) and impact on caregiver (FIS-IC). The disability and burden measures were administered through family interview conducted by trained research assistants.

Translation of these instruments followed a standardized five-step procedure for translation of instruments for use in transcultural research [18]. The PANSS, HAM-D, and Epilepsy-9 were administered by trained clinicians. The other instruments were administered by trained research assistants.

The primary outcomes for the study were the two disorder-specific clinical outcomes (i.e., PANSS score for psychosis and recent seizure for epilepsy) and associated functional impairment (i.e., WHODAS score). All other domains are considered secondary outcomes. Each measure was administered at baseline and at 12 months follow-up.

Analysis

We compared baseline characteristics of the study arms using χ² tests for categorical data and an independent samples t-test for the single sample characteristic with continuous data, age of patient. To evaluate each clinical and functional outcome for the full cohort, we conducted a paired T-test for scaled outcomes, which compared baseline and endpoint scores on each measure for all patients. We evaluated the disorder-specific clinical outcome for epilepsy (i.e. recent seizures), using McNemar’s exact χ² for binomial paired data, which compared the proportion of patients with a recent seizure at baseline to that at endpoint. Analyses were carried out on a per protocol basis.

Differences in clinical and functional outcomes across treatment arms were assessed using an analysis of covariance for each outcome. We set the treatment group as a fixed-effect exposure and baseline score as a covariate, with the patient’s score at endpoint as the outcome. For measures that did not meet Levene’s test for equality of variance, we used a logarithmic transformation to account for heteroscedasticity [19]. We compared the reduction in risk of the dichotomous outcome for epilepsy seizure across treatment arms through logistic regression. Again, treatment arm was set as a fixed-effect exposure and recent seizure at baseline as covariate, with recent seizure at endpoint as the outcome.

Upon reviewing the data for the cohort, there were outliers in the distribution of change scores for multiple scaled measures, indicating the possibility of an underlying non-normal distribution of outcomes. We determined post hoc to use the nonparametric equivalent of the paired T-test, the Wilcoxon Signed-Rank Test, when comparing baseline and end point scores for each measure. It was not necessary to select a nonparametric method for analysis between treatment arms despite the presence of outliers since ANCOVA has demonstrated to be robust against violations of non-normality [20].

Results

Of the 204 patients enrolled at baseline, 85 (42%) and 119 (58%) patients had a primary diagnosis of psychosis and epilepsy, respectively. One hundred fifty-seven (77%) patients were included in the program arm (i.e., comprehensive services package; 63 with psychosis and 94 with epilepsy) and 47 (23%) patients to the control arm (i.e., minimal services package; 22 with psychosis and 25 with epilepsy). The majority of patients were married (64%), Hindu (99%), and did not attend secondary school (72%); approximately half of the patients were male (51%) and worked in agriculture (47%). One hundred seventy-nine (88%) patients completed the clinician interviews at end point, while complete data from family interviews were available for 156 (76%). Table 1 presents the full distribution of sociodemographic characteristics for the sample.

Table 1 Sociodemographic characteristics of sample presented by total and subgroup percentages

The Signed-rank tests provide very strong evidence the cohort made significant improvements in all clinical, functional, and burden-related outcomes. Patients with psychosis made significant improvements in psychotic (Z = 6.78, r = 0.80) and depressive (Z = 6.02, r = 0.70) symptoms, functional impairment (Z = 4.60, r = 0.57), familial burden (BAS: Z = 6.81, r = 0.84; FIS-IC: Z = 5.13, r = 0.64), and social behavior (Z = 5.94, r = 0.84); all measures P < 0.0001. See Tables 2 and 3.

Table 2 Clinical outcome summary scores from clinician interview for patients with psychosis

Table 3 Functional and familial burden for psychosis

The Chi squared test for paired binomial data indicated very strong evidence for a reduction in the risk of recent seizure at end point compared to baseline for patients with epilepsy (relative risk = 0.33, 95% CI 0.24–0.45; P < 0.0001). Patients with epilepsy also demonstrated significant improvements in depressive symptoms (Z = 7.43, r = 0.73), functional impairment (Z = 6.38, r = 0.67), and familial burden (BAS: Z = 8.09, r = 0.85); all measures P < 0.0001. See Tables 4 and 5.

Table 4 Clinical outcome summary scores from clinician interview for patients with epilepsy

Table 5 Functioning and familial burden for epilepsy

We found no evidence of significant differences in endpoint scores, adjusted for baseline scores, for clinical or functional outcomes across treatment arms (P > 0.15 for all measures), except the clinical outcome for epilepsy which indicated a greater reduction in recent seizure between within the comprehensive treatment arm (P = 0.03). Patients with epilepsy in the comprehensive arm had only 0.52 (95% CI 0.29–0.95) the risk of patients in the medication-only arm at end point after adjusting for recent seizure at baseline (P = 0.03). See Tables 2, 3, 4 and 5.

When reviewing for changes in functioning and familial burden for the combined psychosis and epilepsy cohorts, we found significant improvements in functional impairment (Z = 7.83, r = 0.63), familial burden (BAS: Z = 10.56, r = 0.85), and no significant differences when comparing the treatment arms. See Table 6.

Table 6 Functional impairment combined for epilepsy and psychosis

Discussion

The present study evaluates patient-level outcomes of a mhGAP-based mental health care package for people with psychosis and epilepsy in rural Nepal. The findings provide strong evidence that the cohort achieved substantial gains in every domain after 12 months of treatment, including: psychotic symptoms, seizure frequency, and depressive symptoms; functional impairment; burden for the caregiver and family; and social behavior. This means that primary health care workers, after receiving a brief training, are providing mental health care leading to significant improvements among participants. This is especially salient given the fact that the health workers in rural Nepal are all paramedics.

We also compared subgroups within the cohort, namely those that received the comprehensive MHCP consisting of multiple community and facility-level interventions versus a minimal package (eTAU) consisting only of training of health workers and supply of psychotropic medicines. The limitation of sample size inhibits our ability to make definitive interpretations of findings. Still, nearly all analyses suggest no difference in outcomes across treatment arms for all domains, with one exception: patients with epilepsy in receiving the comprehensive MHCP had improved clinical outcomes (i.e., fewer seizures) compared to those receiving the basic MHCP. We did not evaluate the impact of the added components on treatment maintenance and adherence.

This finding suggests that for treating patients with epilepsy extra investment should be made in a treatment package that includes medication as well as counselling, patient support groups and stigma reduction interventions. This should be further evaluated through cost-effectiveness research, in order to assess whether it is worth the additional investments. For any other outcomes, there is no additional gain for an elaborated offer of services compared to training and supply of medication only.

Limitations

The primary limitation of our analyses is a small sample size. The final sample size after attrition and exclusion of patients with missing data was n = 179 for measures administered through clinician interview, and fewer for those administered through family interviews. This limitation is common to studies in low-resource settings; moreover, a relatively small sample size is a hallmark of cohort studies. The findings for primary objectives are not substantially affected by the sample size. It is in the comparisons of secondary objectives where the small sample size affects our ability to conduct subgroup analyses and will further limit findings should additional inferential analyses be conducted. Future research may consider testing specific hypotheses in addition to those presented here. For example, how might treatment adherence affect disorder-specific outcomes, or are beliefs regarding the cause of psychosis associated with improvements in familial burden and functional impairment? Finally, as a result of the absence of a control group that received no treatment at all (deemed unethical in the context of this study), we cannot empirically attribute change to the treatment. However, given the chronicity of the epileptic and psychotic symptoms, and the strong effects found, it is highly plausible that treatment has contributed to such change.

Conclusions

The findings provide strong evidence for clinical improvements following mental health care delivered by primary health care workers—even paramedic staff—in treating epilepsy and psychosis. The study also shows the effect of that treatment in symptoms of depression, functional impairment and feelings of burden among family members. A more comprehensive package of care, including counselling and patient support groups, appears to offer added clinical benefits for patients with epilepsy. This entails that investments for additional psychosocial services beyond the chiefly pharmacological treatment provided by the health workers translate in significantly better treatment results. At the same time, for people with psychosis the basic package of care (i.e., psychotropic medications) performed similar to the more comprehensive package, suggesting a less resource-intensive package may offer comparable results. In conclusion, our findings demonstrate the ability of this treatment model to significantly improve the lives of those with MNS disorders and those their families. These findings also demonstrate the viable of a scalable, integrated treatment model, which, if adopted into the wider healthcare system, could dramatically expand access to mental health care for people with MNS disorder in Nepal.