Skip to main content
Download PDF
Download ePub

Operational challenges in the pre-intervention phase of a mental health trial in rural India: reflections from SMART Mental Health

International Journal of Mental Health Systems volume 16, Article number: 42 (2022) Cite this article

Abstract

Background

Availability of mental health services in low- and middle-income countries is largely concentrated in tertiary care with limited resources and scarcity of trained professionals at the primary care level. SMART Mental Health is a strategy that combines a community anti-stigma campaign with a primary health care workforce strengthening initiative, using electronic decision support with the goal of better identifying and supporting people with common mental disorders in India.

Methods

We describe the challenges faced and lessons learnt during the pre-intervention phase of SMART Mental Health cluster Randomised Controlled Trial. Pre-intervention phase includes preliminary activities for setting-up the trial and research activities prior to delivery of the intervention. Field notes from project site visit, project team meetings and detailed follow-up discussions with members of the project team were used to document operational challenges and strategies adopted to overcome them. The socio-ecological model was used as the analytical framework to organise the findings.

Results

Key challenges included delays in government approvals, addressing community health worker needs, and building trust in the community. These were addressed through continuous communication, leveraging support of relevant stakeholders, and addressing concerns of community health workers and community. Issues related to use of digital platform for data collection were addressed by a dedicated technical support team. The COVID-19 pandemic and political unrest led to significant and unexpected challenges requiring important adaptations to successfully implement the project.

Conclusion

Setting up of this trial has posed challenges at a combination of community, health system and broader socio-political levels. Successful mitigating strategies to overcome these challenges must be innovative, timely and flexibly delivered according to local context. Systematic ongoing documentation of field-level challenges and subsequent adaptations can help optimise implementation processes and support high quality trials.

Trial registration: The trial is registered with Clinical Trials Registry India (CTRI/2018/08/015355). Registered on 16th August 2018. http://ctri.nic.in/Clinicaltrials/showallp.php?mid1=23254&EncHid=&userName=CTRI/2018/08/015355

Background

Low and middle-income countries (LMICs) experience a large disease burden from mental disorders [1, 2]. Only a small proportion of individuals needing mental health care can access it, leading to large treatment gaps [3, 4]. In India, around 150 million people are in need of care for depression, anxiety, and alcohol and other substance use disorders [5]. Major barriers to accessing mental health services include the stigma associated with mental illnesses and care seeking, lack of a trained workforce especially in primary care settings, limited public funding for mental health services and large out-of-pocket costs [2, 6,7,8].

The Systematic Medical Appraisal Referral and Treatment (SMART) Mental Health programme aims to reduce treatment gaps for psychological stress, depression, anxiety and increased self-harm risk (collectively referred to here as common mental disorders for the project) in rural India [9]. The integrative strategy comprises of two broad components—a community level anti-stigma campaign to address community demand side barriers and the use of an electronic decision support system (EDSS) using mobile devices to help community health workers and primary health centre (PHC) doctors in the diagnosis and management of people with common mental disorders (CMDs).

Previous studies have identified several challenges in implementation of complex interventions including demands on staff, patient preferences, patient-staff dynamics, difficulties in recruitment and retention in trials, and organisational context. Additionally, external factors including policy or market level changes may also impact such interventions [10,11,12]. These challenges have been reported in both hospital-based trials as well as community-based trials, mainly from high income country settings with limited literature on community-based trials in LMICs [13].

SMART Mental Health is being evaluated in a cluster randomized controlled trial (cRCT) with specific activities in the pre-intervention, intervention, and post-intervention phases (Fig. 1). This paper focuses only on the pre-intervention phase of the SMART Mental Health project. It aims to identify contextual factors that may influence operationalising complex interventions, provide information about adaptations which need to be made to address emergent challenges, and address knowledge gaps on implementation barriers of health service interventions in LMICs [14].

Fig. 1
figure 1

SMART Mental Health-Project Phases

Full size image

Method

Project background

SMART Mental Health is being implemented in three districts across two states in India: West Godavari district in the southern state of Andhra Pradesh, Palwal and Faridabad districts in the northern state of Haryana. West Godavari is a coastal district with a population of about 3.9 million [15]. Telugu is the most commonly spoken language in the area. Palwal and Faridabad districts are close to the national capital New Delhi. Faridabad with a population of about 1.8 million [16] is nearly 45 kms m from New Delhi while Palwal with a population of close to 1 million [17] is nearly 75 kms from the national capital. Hindi and the local dialect Haryanvi are the most spoken languages in these districts. All the three districts are predominantly rural agricultural areas. The districts have differences in availability of mental health services in government settings. Faridabad district has one psychiatrist at the district hospital as well as out-patient psychiatry services available at another government hospital. Palwal district hospital does not have a psychiatrist. The psychiatrist from Faridabad district hospital provides services in Palwal once a week. West Godavari has a well-functioning psychiatry unit at the district hospital. The psychiatrist also makes regular visits to the PHCs in her district to offers psychiatry out-patient services on specified days. Private psychiatric services are available more widely in West Godavari and Faridabad compared to Palwal.

A cluster for  SMART Mental Health cRCT is the Primary Health Care Centre (PHC) and the communities serviced by that PHC. A rural PHC in India typically serves a population of about 30,000 people with one at least one medical doctor available in each PHC [18] supported by other paramedical and administrative staff. The PHCs are the lowest rung of the primary health care delivery system which has a doctor.

The pre-intervention phase consists of preliminary groundwork for setting up the study and research activities prior to randomization of clusters and delivery of the intervention components. This included identification of PHC services, obtaining permissions from state and district level health authorities and consultation with village stakeholders including elected representatives. Research activities included:

  1. (i)

    site visits to draw maps of clusters with relevant information (such as location of health centres, pharmacies);

  2. (ii)

    village level census for listing of all households in the study clusters;

  3. (iii)

    formative research to obtain feedback from community and health workers on the proposed intervention tools (app based EDSS and anti-stigma campaign content);

  4. (iv)

    training of community health workers known as Accredited Social Health Activists (ASHAs) in India to screen for CMDs;

  5. (v)

    household screening undertaken by ASHAs with standardised screening tools—Generalized Anxiety Disorder-7 item(GAD-7) [19, 20] and Patient Health Questionnaire-9 item scales(PHQ-9) [21, 22]—using handheld tablet devices,to identify individuals at high risk of common mental disorders;

  6. (vi)

    a confirmatory re-screen of people identified at high-risk cohort within 6 months of initial screening (to exclude those who have experienced natural remission); and

  7. (vii)

    a baseline survey by an independent data collection team, to measure knowledge, attitude and practices related to mental health.

In the intervention phase of the trial, those PHCs allocated to SMART health will receive a community level anti-stigma campaign using print and audio-visual communication tools and enhanced mental health service delivery by PHC doctors and ASHAs using EDSS. The EDSS uses World Health Organization’s Mental Health Gap Action Programme- Intervention Guide (mhGAP-IG) to support diagnosis and treatment decisions of PHC doctors. It provides ASHAs information on high-risk persons who need to be followed-up and referred to the PHC doctors. PHCs in the control arm will receive enhanced usual care in which all individuals identified at high risk of a CMD will be encouraged to attend their local PHC and/or seek specialist opinion. The intervention will be provided for 12 months. Following this in a post-trial phase the intervention components will be provided to both usual care and intervention arms with minimal support from research staff to assess the sustainability and scalability of the intervention [9].

Identifying challenges

To identify the key challenges faced during the pre-intervention phase, field notes from the following sources were used:

  • Observation during visits to the project site (in Haryana only)

  • Discussion with ASHAs and field staff during field visits in Haryana and using online modes in Andhra Pradesh

  • Meeting notes involving research fellows at both sites

  • Notes from weekly project update meetings with the principal investigator

  • Email correspondence with team members

All weekly team meetings of the research fellows with the principal investigator were attended by the author (AM). Due to COVID restrictions, field visits could not be made to Andhra Pradesh. A review of notes from meetings and field visits helped in identifying a broad range of operational challenges faced in the pre-intervention phase. To gain greater insights into these challenges, discussion with eight project team members (Table 1) were held. Domains covered during these discussions are indicated under the ‘challenges’ column in Table 2. The project team members were asked to discuss in detail about each of the challenges identified in the field notes, strategies used to overcome them and any lessons they felt were learnt. They were also asked to share any operational challenges that had not been captured in the field notes. These discussions were held in-person, telephonically, through video chat, over email and included inputs from the research fellows, IT staff, and field level project supervisors in both states. Two research fellows and one field supervisor were included from Andhra Pradesh site while two research fellows and two field supervisors were included from Haryana site, apart from the IT staff working for both sites. Information provided by project team supplemented the field notes and provided a detailed picture of challenges during the pre-intervention phase and strategies adopted by the team to overcome these challenges. No formal audio recording of the discussions with team members were done. However written responses from email communication have been quoted here in the paper.

Table 1 SMART Mental Health project team members with whom discussions were held
Full size table
Table 2 Key Operational Challenges in the pre-intervention phase and strategies used to overcome them
Full size table

Analysis

The above data sources were reviewed to identify key areas where challenges were faced during the pre-intervention phase. It was felt that a framework for organising all the challenges listed by the project team would provide better understanding of the findings. The Socio-ecological Model (SEM) [23] was used to organise identified challenges, based on levels where these challenges emerged. This was reviewed by the project team to arrive at a consensus. The SEM uses nested concentric circles to situate micro- to macro-level factors that impact a problem (Fig. 2). It identifies various levels—individual, interpersonal, institutional/organisational, community and environment—at which factors impacting a problem may be located. This framework has been used widely to understand factors or determinants at various levels which influence a problem [24], to design multi-level interventions [25] and as a framework for evaluation of intervention strategies [26].

Fig. 2
figure 2

Socio-Ecological Model Levels at which operational challenges were faced and actions were taken in the SMART Mental Health cRCT

Full size image

Ethics

The study received ethics approval from the Independent Ethics Committee of the George Institute, India and the All India Institute of Medical Sciences, New Delhi. It has been registered with Clinical Trials Registry India (CTRI/2018/08/015355).

Results

During the pre-intervention phase, several challenges were faced at different levels, and these are summarized in Table 2. Below we elaborate on the key issues identified at each level. Many of the challenges and strategies adopted to address them corresponded to multiple levels.

Individual level

While engaging with ASHAs, one major challenge related to dissatisfaction amongst some ASHAs with the remuneration they were receiving for their involvement in the project, which impacted their motivation to participate in the project.

“During the screening phase ASHAs in some PHCs had stopped working and had started influencing ASHAs in other PHCs to stop working too, which also coincided with state union strikes. This would have greatly jeopardised completing screening activities on time and would have delayed future activities too”. (Research Fellow 1, Haryana).

Strategies to address this included open dialogue with ASHAs to understand their grievances and talking to relevant line managers connected to ASHAs. A revised incentive structure was put in place to address remuneration concerns.

“We spoke with the concerned ASHAs who were not willing to work and tried to understand their concerns. We then revised the screening incentive structure, i.e., from payment being capped for a particular number of screenings to (payment) per screening completed” (Research Fellow 1, Haryana).

Building relationships with ASHAs was considered critical to sustaining their involvement in the programme “With ASHAs the work seems routine, but they have different issues at individual and group levels. Building a rapport with the ASHAs and talking to them regularly formally and informally, having regular meetings and discussions with them resolved many issues. (Research Fellow 2, Andhra Pradesh).

There were some differences in the two states in terms of willingness of ASHAs to participate in the project. In AP we had to replace nearly 15% of the ASHAs with local staff in the pre-intervention phase. While some dropped out due to personal reasons, others cited high work burden. Another reason stated was the significant increase in remuneration of ASHAs in AP. Several ASHAs did not feel the need for additional monetary support that the project provided. In contrast only about 5% ASHAs had to be replaced in Haryana.

Interpersonal level

Some challenges at the level of the family were also identified. Family members of some ASHAs in Haryana were unhappy for them being accompanied by male field staff in the village. Senior supervisory staff reached out to family members, listened to the concerns raised by them and tried to address these by providing detailed information on the project, its goals, and the need for supervision. The family were assured that male staff would always follow culturally appropriate behaviour. This was a challenge specific to Haryana, as norms around segregation between men and women (especially younger women) are quite marked there compared to Andhra Pradesh. Another challenge in Haryana was finding persons with lived experience (PWLE) of mental illness who were willing to share their experience on camera as part of the anti-stigma campaign materials. Concerns from family members due to fear of stigma was an important reason behind refusal from PWLEs.

““As part of screening phase in rural Haryana, some ASHAs and field staff did manage to identify few PWLEs who were ready to share their stories with the research and field team. However, they refused to give consent for the same given their family’s apprehensions regarding their reputation in society, future marriage alliances and being labelled with stigmatized words and adjectives.” (Research Fellow 3, Haryana).

Despite sustained efforts to find PWLEs willing to be featured in the anti-stigma videos in Haryana, the plan ultimately had to be abandoned. Instead, videos from consenting PWLEs from the other study region (Andhra Pradesh) were translated and dubbed into the local language and dialect of Haryana. Additional time was taken in obtaining consent from individuals featured in the videos from Andhra Pradesh and in addition to the translation process took much longer than was originally anticipated.

Institutional/Organisational level

Many of the challenges were faced at the institutional/organisational level. Some of these were related to external institutions like the health department. Challenges included delays in obtaining approvals/permissions, transfer of officials, and delays in written communication between the higher and lower levels of the concerned department.

Some challenges needed to be addressed by the project team at the internal organisational level. For example, challenges related to technical aspects of the mHealth platform, which required iterative changes to be made by the informational technology support team. There were some difficulties experienced by ASHAs related to the user-interface which was resolved by adopting appropriate solutions to make the app more user-friendly for ASHAs. Based on continuous feedback from the project team, several changes were also made to improve data safety and security, data analytics, and improved backend processes (discussed in Table 2).

Community level

Issues related to mistrust, prevailing sociocultural norms/beliefs, stigma related to mental health, were emerged at the community level in both sites. This required continuous engagement with the community by the project team to build trust and included enlisting support of local leaders including village elders, community leaders, local administrators, and religious leaders. Political unrest due to community opposition to two citizenship legislations—the Citizenship Amendment Act and the National Register of Citizens—emerged as an unanticipated challenge, which needed to be addressed at the community level. Although the challenge emerged due to change in policy context, the implications were at the community level. The two laws had implications for sharing of personal identifiers for official purposes, which led to subsequent mistrust by religious minorities from some villages to offer any data or sign any documents such as research consent forms. Due to mistrust of the government, any outsiders who came to the village to gather any form of information were viewed suspiciously. Despite taking permission from local village leaders, field workers who were collecting data for the baseline survey faced refusal and even verbal threats in several villages in both Haryana and Andhra Pradesh.

“There were bigger challenges when the whole community was opposed to (us) collecting information and the issue went on till the staff received a warning of dire consequences. Considering it as a refusal at a community level, efforts were made to meet (persons who had refused) again and again. This did not work at all as the entry itself was closed and (we) couldn’t have a dialogue, not even with a single person from the community.” (Research Fellow 2, Andhra Pradesh).

To address these concerns, efforts were made to solicit support from influential persons including religious leaders, administrators, elected local body representatives, village elders, and influential community leaders from other villages and political party leaders. In Andhra Pradesh a breakthrough came after help was sought from the religious leader of a nearby village. Project team members reached out to the religious leader and explained the purpose of data collection, the overall goal of the project and provided information about the research institute and clarified any doubts he had. He was aware of some of the work done in the area by the project team in the past and was appreciative of the institute’s efforts to address mental health issues in the area. He reached out to several members of his community including the community head of the village and discussed with them the purpose of the research, the concerns about data sharing, and clarifyied the distinction between the policies of the national government and the activities of the research team.

Policy/enabling environment

The COVID-19 pandemic was a significant environmental level challenge which threatened the project. Addressing this challenge required innovative solutions, flexibility, and adaptation. Pandemic-related restrictions led to delays in starting the intervention in both sites. On 24th March 2020 a nationwide lockdown was announced for 21 days, which subsequently lasted over two months. At the time the lockdown was announced, the pre-intervention phase was coming to an end and trainings for the intervention phase were being planned in Haryana. The intervention was delayed and could start only by 21st September 2020 in Haryana. In Andhra Pradesh a little over half the population had been screened by ASHAs at the time of the lockdown. Work was resumed in June in areas where lockdown had been eased. In AP the intervention started on 4th December 2020.

After the lockdown eased training for the re-screening and baseline phase needed to be conducted in Andhra Pradesh. Face to face trainings planned earlier were no longer feasible. After several consultations with district health officials, a plan for remote training of ASHAs, following all necessary precautions and guidelines for COVID, was agreed upon. The entire training content for ASHAs was digitised and adapted for remote delivery.

“Due to the pandemic, it was extremely difficult to conduct the trainings face to face and hence we as a team decided to use online modes for conducting the training. Since our training involved a lot of technological aspects, we developed the online material along with the supervisor and conducted the training of ASHAs and field staff which was received very well for the baseline and ASHA-re screening. (Research Fellow 4, Andhra Pradesh).”

Discussion

Operational challenges in the pre-intervention phase of the SMART Mental Health and strategies to overcome these challenges were documented systematically and have been presented in this paper. The SEM provided the analytical framework to analyse these challenges. We found it to be a useful analytical tool as it provided a comprehensive and layered understanding of how contextual challenges that emerge, need to be addressed at multiple levels. The exercise of documenting and systematically reporting challenges provided us with several important lessons.

Some of the operational challenges need to be addressed at the individual level. Issues specific to some AHSAs like poor motivation were addressed through detailed discussions with them. Dissatisfaction with remuneration may emerge as a major challenge in projects that need active participation of community health workers. Financial incentives are an important factor influencing motivation of ASHAs [27, 28]. Similar observations about the role of financial incentives in motivation of community health workers has been made in other LMIC contexts [29]. Remuneration to CHWs is usually provided as fixed salary or incentive against services. It was found that in both cases an ‘expectation gap’ of what was perceived as fair compensation versus what was actually paid, affected motivation of CHWs [29, 30]. Open and transparent dialogue to address remuneration related expectations of ASHAs was an important strategy in the project which helped to address this. Taking time to understand and address specific project related grievances of individual ASHAs was useful in our programme. Relationship and rapport building as well as having both formal and informal communication with ASHAs were important strategies to keep them motivated to be part of the project.

In our context and for several other LMIC context, family, and relatives play an important role in individual decision making [28, 31]. Although research participants and community health workers were our primary stakeholders, we found the need to reach out to their families on several occasions. Interaction with family members may need to be undertaken by a senior supervisory staff who can clearly communicate the project objectives and clarify any doubts of family members. Understanding broader community context and how that affects personal choices should also be taken into consideration while developing implementation research. This has been highlighted in several guidelines for complex interventions [32, 33].

Issues emerging from external institutional level factors like delay in permissions are difficult to address. The ability to obtain government level approvals has flow-on effects downstream. This was a pre-requisite for getting support from PHC doctors and ASHAs to participate in our project. Some of this was facilitated by our continuing relationship with key officials and at other times it just needed patience and repeated discussions with officials. Bureaucracy and research governance have been highlighted as important barriers in undertaking clinical as well as intervention trials in other contexts [34,35,36,37]. Some studies have reported need for approvals from multiple agencies increasing bureaucratic requirements from researchers as important barriers. This has been seen to cause delays and increased costs in implementing trials [37, 38]. There have been calls for simplifying research governance with a view to balancing patient safety and research needs, primarily from high income country contexts [34, 36, 37]. This is equally relevant in the Indian context.

At the internal organisational level, it is important to create feedback loops to make continuous improvements where needed. This is crucial for community based mHealth interventions. In recent years there has been a rise in mHealth intervention in LMIC context [39]. However, challenges to scale-up, adoption and integration in routine clinical practice remain. Resource constraints constitute an important barrier [39]. Other barriers may be at the design level. Poor acceptability due to low ease of use, high design complexity and design mismatch with the real-world context of the end users are some challenges reported for mHealth interventions [13, 40, 41]. Agile software development and user centred design have been demonstrated as useful approaches to improve acceptability of mHealth platforms in recent implementation research literature [40, 42,43,44]. The Agile principles were developed in the field of information sciences and emphasize on using cross-functional teams and engagement with end users to make continuous improvements to software [45]. User centred design principles advocate keeping the end user in the centre of the design process and creating or modifying design to suit end user needs [43]. We found having a dedicated IT team which was updated on a weekly basis about any challenges faced was an important strategy for smooth functioning of technology related components. Continuous adaptations were made based on feedback from the project team, to improve user interface and minimise errors. Interdisciplinary teams consisting IT experts and health professionals, and continuous communication and sharing of ideas between them have been effective strategies for design and implementation of mHealth interventions [46].

Community level interventions need sustained efforts to have buy-in from the community for the project. This is a continuous process and is influenced by community perceptions of research activities that had previously been conducted in the regions. At the very start of the project it is important to reach out to important community leaders. In case of mistrust or opposition from sections of the community we found leveraging the support of influential persons in the community to be most helpful. Engagement with community and religious leaders for wider acceptance of health interventions has been demonstrated to work in several LMIC contexts. Successful engagement with Muslim opinion leaders for improved uptake of maternal and child health services in Nigeria [47], engagement with community leaders in Guinea during the Ebola outbreak [48] and partnership with community leaders in Democratic Republic of Congo for better access to contraceptive and abortion care [49] have been reported. Due to their position in the community, they are in a unique position to positively influence community level health interventions. Our project does not have a formal partnership with community leaders. However regular communication and rapport building has been a helpful strategy to solicit their support for our project.

Since RCTs have strict protocols and need several rounds of data collection in the community, it is important to discuss this comprehensively at the outset. Despite doing this, we found there was also a need for ongoing discussion to explain project objectives and clarify any doubts as and when they emerge from within the community. Stigma associated with mental health adds another level of complexity and can led to reluctance to share data as seen in our case. This underscores the critical importance of integrating stigma reduction activities in any community based mental health intervention [50]. We have also seen in our previous work that there is greater community acceptance of the project with time as benefits from the intervention start reaching community members [51].

Challenges emerging at the policy or external environment may have important implications for implementors. Policies that may not be directly related to our work may impact it in unexpected ways. The citizenship legislations and the ensuing protests and mistrust impacted our ability to collect data in certain communities. It needed community level solutions like leveraging support of key community leaders that had to be adopted.

The COVID-19 pandemic has impacted research trials across the globe. Management of ongoing trials has faced several challenges and some trials have been temporarily paused [52]. Some of the challenges include difficulty in recruitment and obtaining informed consent from participants, conducting training and data collection. Communication with staff and stakeholders and onsite monitoring have also been impacted due to the pandemic [53]. The COVID-19 pandemic disrupted the ‘when and how’ which were planned for certain timely deliverables of our project. As a result, intervention delivery was delayed in both sites. Since this was a community-based trial, COVID related restrictions led to several barriers in undertaking project activities. Flexibility and making adaptations may be needed in such cases. We had to find solutions like remote training of community health workers, remote monitoring of field staff, adjusting timelines and seeking approval to make certain protocol amendments. Recent literature supports this view. Adaptation and flexibility in trial management has been crucial in most cases to overcome challenges posed by the pandemic. A study based on inputs from trial managers from UK found that sponsors eased approval for use of digital tools for recruitment and consent in some cases. Use of technology to undertake activities remotely has emerged as an important solution. Both electronic and digital communication tools to undertake research have been used for participant recruitment, obtaining informed consent, providing health services remotely and substituting for onsite monitoring and communication with staff [53, 54]. There is need to further document and better understand strategies being adopted by researchers to deal with barriers emerging because of the pandemic.

Implications of the findings

Systematic documentation of operational challenges in executing pre-intervention research activities, has been a valuable exercise for the project. It has provided important insights for the project team on critical factors that might impact implementation fidelity. A similar exercise will be undertaken during the other study phases to identify other operational challenges and strategies adopted to overcome them.

The findings potentially have implications beyond this project. It may be of relevance to implementation of complex health service strengthening strategies more broadly and contribute to the literature on challenges of operationalising such interventions in LMIC settings.

Limitations

The paper uses insights of research fellows, the IT staff and project supervisors to understand operational challenges faced during implementation of the project. However, field supervisors and field investigators were not formally interviewed as senior staff were able to provide information on field level operational challenges. Although the lead author attended some meetings with field staff, this was done on an ad hoc basis and may not have systematically captured their perspectives. Field visits could only be made to the Haryana site as COVID related travel restrictions prevented visits to the Andhra Pradesh sites. In focussing mainly on project implementer views, this may introduce some bias as other perspectives were not prioritised. The paper is not intended as an unbiased evaluative piece but as a reflective piece on the research practice from those directly engaged in implementation of the intervention.

Conclusion

Implementation of complex interventions may pose challenges at several levels. Community-based interventions in LMIC contexts have additional layers of complexity that have not been well documented. Identification of challenges in the pre-trial phase and developing strategies to address these has generated important lessons which may be of value for future health service intervention research in LMIC contexts. We recommend: (1) the need to engage with all stakeholders continually and actively during the implementation as well design process to have greater buy-in for the research; (2) a high degree of agility in making adaptations and leveraging technology to overcome the major and unanticipated barriers related to COVID; (3) a need to rigorously document challenges and adaptations to aid with the interpretation of findings from process evaluations and (4) policy reform to support more streamlined research governance processes.

Availability of data and materials

Not applicable.

Abbreviations

ANM:

Auxiliary nurse midwife

ASHA:

Accredited Social Health Activist

CMD:

Common mental disorders

cRCT:

Cluster randomized control trial

COVID-19:

Coronavirus disease 2019

EDSS:

Electronic decision support system

IT:

Information technology

LMICs:

Low and middle-income countries

mHealth:

Mobile health

mhGAP:

Mental Health Gap Action Programme

PHC:

Primary health centre

PWLE:

Person with lived experience

SEM:

Socio-ecological Model

SMART:

Systematic Medical Appraisal Referral and Treatment

References

  1. Patel V. Mental health in low- and middle-income countries. Br Med Bull. 2007;81–82:81–96. https://doi.org/10.1093/bmb/ldm010.

    Article  PubMed  Google Scholar 

  2. The WHO World Mental Health Survey Consortium. Prevalence, Severity, and Unmet Need for Treatment of Mental Disorders in the World Health Organization World Mental Health Surveys. JAMA. 2004;291:2581–90. https://doi.org/10.1001/JAMA.291.21.2581.

    Article  Google Scholar 

  3. Sagar R, Pattanayak RD, Chandrasekaran R, Chaudhury PK, Deswal BS, Singh RKL, et al. Twelve-month prevalence and treatment gap for common mental disorders: findings from a large-scale epidemiological survey in India. Indian J Psychiatry. 2017;59:46–55. https://doi.org/10.4103/psychiatry.IndianJPsychiatry_333_16.

    Article  PubMed  PubMed Central  Google Scholar 

  4. Kohn R, Saxena S, Levav I, Saraceno B. The treatment gap in mental health care. Bull World Health Organ. 2004;82:858–66.

    PubMed  PubMed Central  Google Scholar 

  5. Gururaj G, Varghese M, Benegal V, Rao GN, Pathak K, Singh LK, Mehta RY, Ram D, Shibukumar TM, Kokane A, Lenin Singh RK, Chavan BS, Sharma P, Ramasubramanian C, Dalal PK, Saha PK , Deuri SP, Giri AK, Kavishvar AB, Sinha VK, Thavody J, Chatterji R, Akoijam MR. National Health Survey of India 2015–16: Prevalence, patterns and outcomes. Bangalore; 2016. http://indianmhs.nimhans.ac.in/Docs/Report2.pdf.

  6. Sweetland AC, Oquendo MA, Sidat M, Santos PF, Vermund SH, Duarte CS, et al. Closing the mental health gap in low-income settings by building research capacity: Perspectives from Mozambique. Ann Glob Health. 2014;80:126–33.

    Article  Google Scholar 

  7. Clement S, Schauman O, Graham T, Maggioni F, Evans-Lacko S, Bezborodovs N, et al. What is the impact of mental health-related stigma on help-seeking? A systematic review of quantitative and qualitative studies. Psychol Med. 2015;45:11–27. https://doi.org/10.1017/S0033291714000129.

    Article  CAS  PubMed  Google Scholar 

  8. Saraceno B, van Ommeren M, Batniji R, Cohen A, Gureje O, Mahoney J, et al. Barriers to improvement of mental health services in low-income and middle-income countries. Lancet. 2007;370:1164–74. https://doi.org/10.1016/S0140-6736(07)61263-X.

    Article  PubMed  Google Scholar 

  9. Daniel M, Maulik PK, Kallakuri S, Kaur A, Devarapalli S, Mukherjee A, et al. An integrated community and primary healthcare worker intervention to reduce stigma and improve management of common mental disorders in rural India: protocol for the SMART Mental Health programme. Trials. 2021;22:179. https://doi.org/10.1186/s13063-021-05136-5.

    Article  PubMed  PubMed Central  Google Scholar 

  10. Randell E, McNamara R, Shaw C, Espinasse A, Simpson SA. Challenges of a community based pragmatic, randomised controlled trial of weight loss maintenance Public Health. BMC Res Notes. 2015;8:1–9. https://doi.org/10.1186/s13104-015-1791-7.

    Article  Google Scholar 

  11. McAlearney AS, Walker DM, Livaudais-Toman J, Parides M, Bickell NA. Challenges of implementation and implementation research: learning from an intervention study designed to improve tumor registry reporting. SAGE Open Med. 2016;4:205031211666621. https://doi.org/10.1177/2050312116666215.

    Article  Google Scholar 

  12. Datta J, Petticrew M. Challenges to evaluating complex interventions: a content analysis of published papers. BMC Public Health. 2013;13:1–18. https://doi.org/10.1186/1471-2458-13-568.

    Article  Google Scholar 

  13. van Olmen J, Erwin E, García-Ulloa AC, Meessen B, Miranda JJ, Bobrow K, et al. Implementation barriers for mHealth for non-communicable diseases management in low and middle income countries: a scoping review and field-based views from implementers. Wellcome Open Res. 2020. https://doi.org/10.12688/wellcomeopenres.15581.2.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Wells M, Williams B, Treweek S, Coyle J, Taylor J. Intervention description is not enough: evidence from an in-depth multiple case study on the untold role and impact of context in randomised controlled trials of seven complex interventions. Trials. 2012. https://doi.org/10.1186/1745-6215-13-95.

    Article  PubMed  PubMed Central  Google Scholar 

  15. West Godavari District, Government of Andhra Pradesh | India. National Informatics Centre, Ministry Of Electronics & Information Technology, Government Of India. 2021. https://westgodavari.ap.gov.in/. Accessed 8 Nov 2021.

  16. District Faridabad| Haryana | India. National Informatics Centre, Ministry of Electronics and Information Technology, Government of India. 2021. https://faridabad.nic.in/. Accessed 8 Nov 2021.

  17. District Palwal | Haryana | India. National Informatics Centre, Ministry Of Electronics & Information Technology, Government Of India. 2021. https://palwal.gov.in/. Accessed 8 Nov 2021.

  18. Indian Public Health Standards (IPHS) Guidelines for Primary Health Centres. New Delhi; 2012.

  19. Pfizer Inc. GAD-7. https://www.phqscreeners.com/images/sites/g/files/g10060481/f/201412/GAD7_English for the UK.pdf. Accessed 20 Jul 2020.

  20. Spitzer RL, Kroenke K, Williams JBW, Löwe B. A brief measure for assessing generalized anxiety disorder: The GAD-7. Arch Intern Med. 2006;166:1092–7. https://doi.org/10.1001/archinte.166.10.1092.

    Article  PubMed  Google Scholar 

  21. Pfizer Inc. Patient Health Questionnaire- 9 (PHQ-9). 2010. https://www.phqscreeners.com/images/sites/g/files/g10060481/f/201412/PHQ9_English for India.pdf. Accessed 20 Jul 2020.

  22. Kroenke K, Spitzer RL, Williams JBW. The PHQ-9: Validity of a brief depression severity measure. J Gen Intern Med. 2001;16:606–13. https://doi.org/10.1046/j.1525-1497.2001.016009606.x.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  23. Mcleroy KR, Bibeau D, Steckler A, Glanz K. An Ecological Perspective on Health Promotion Programs. Heal Educ Behav. 1988;15:351–77. https://doi.org/10.1177/109019818801500401.

    Article  CAS  Google Scholar 

  24. Pereira MMC, Padez CMP, Nogueira HG. Describing studies on childhood obesity determinants by Socio-Ecological Model level: a scoping review to identify gaps and provide guidance for future research. Int J Obes. 2019;43:1883–90. https://doi.org/10.1038/s41366-019-0411-3.

    Article  Google Scholar 

  25. Centre for Disease Control. The Social-Ecological Model: A Framework for Prevention |Violence Prevention|Injury Center|CDC. https://www.cdc.gov/violenceprevention/about/social-ecologicalmodel.html. Accessed 7 Jun 2021.

  26. Kellou N, Sandalinas F, Copin N, Simon C. Prevention of unhealthy weight in children by promoting physical activity using a socio-ecological approach: What can we learn from intervention studies? Diabetes Metab. 2014;40:258–71.

    Article  CAS  Google Scholar 

  27. Wahid SS, Munar W, Das S, Gupta M, Darmstadt GL. ‘Our village is dependent on us. That’s why we can’t leave our work’. Characterizing mechanisms of motivation to perform among Accredited Social Health Activists (ASHA) in Bihar. Health Policy Plan. 2020;35:58–66. https://doi.org/10.1093/HEAPOL/CZZ131.

    Article  PubMed  Google Scholar 

  28. Sarin E, Lunsford SS. How female community health workers navigate work challenges and why there are still gaps in their performance: A look at female community health workers in maternal and child health in two Indian districts through a reciprocal determinism framework. Hum Resour Health. 2017;15:1–10. https://doi.org/10.1186/s12960-017-0222-3.

    Article  Google Scholar 

  29. Singh D, Negin J, Otim M, Orach CG, Cumming R. The effect of payment and incentives on motivation and focus of community health workers: five case studies from low- and middle-income countries. Hum Resour Heal. 2015;13:1–12. https://doi.org/10.1186/S12960-015-0051-1.

    Article  Google Scholar 

  30. Ormel H, Kok M, Kane S, Ahmed R, Chikaphupha K, Rashid SF, et al. Salaried and voluntary community health workers: exploring how incentives and expectation gaps influence motivation. Hum Resour Health. 2019. https://doi.org/10.1186/S12960-019-0387-Z.

    Article  PubMed  PubMed Central  Google Scholar 

  31. Ezenwaka U, Mbachu C, Ezumah N, Eze I, Agu C, Agu I, et al. Exploring factors constraining utilization of contraceptive services among adolescents in Southeast Nigeria: An application of the socio-ecological model. BMC Public Health. 2020;20:1–11. https://doi.org/10.1186/s12889-020-09276-2.

    Article  Google Scholar 

  32. Craig P, Di RE, Frohlich KL, Mykhalovskiy E, White M, Campbell R, et al. Taking account of context in population health intervention research: guidance for producers, users and funders of research. Southhampton. 2018. https://doi.org/10.3310/CIHR-NIHR-01.

    Article  Google Scholar 

  33. Craig P, Dieppe P, Macintyre S, Mitchie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: The new Medical Research Council guidance. BMJ. 2008;337:979–83. https://doi.org/10.1136/bmj.a1655.

    Article  Google Scholar 

  34. Duley L, Antman K, Arena J, Avezum A, Blumenthal M, Bosch J, et al. Specific barriers to the conduct of randomized trials. In: Clinical Trials. Sage PublicationsSage UK: London, England; 2008. p. 40–8. doi:https://doi.org/10.1177/1740774507087704.

  35. Djurisic S, Rath A, Gaber S, Garattini S, Bertele V, Ngwabyt S-N, et al. Barriers to the conduct of randomised clinical trials within all disease areas. Trials. 2017;18:1–10. https://doi.org/10.1186/S13063-017-2099-9.

    Article  Google Scholar 

  36. Rule S, LeGouill S. Bureaucracy is strangling clinical research. BMJ. 2019. https://doi.org/10.1136/bmj.l1097.

    Article  PubMed  Google Scholar 

  37. de Jonge JC, Reinink H, Colam B, Alpers I, Ciccone A, Csiba L, et al. Regulatory delays in a multinational clinical stroke trial. Trail. 2021;6:120–7. https://doi.org/10.1177/23969873211004845.

    Article  Google Scholar 

  38. Snooks H, Hutchings H, Seagrove A, Stewart-Brown S, Williams J, Russell I. Bureaucracy stifles medical research in Britain: A tale of three trials. BMC Med Res Methodol. 2012;12:1–9. https://doi.org/10.1186/1471-2288-12-122.

    Article  Google Scholar 

  39. Qiang CZ, Qiang CZ, Yamamichi M, Hausman V, Miller R, Altman D, et al. Mobile applications for the health sector. Washington DC; 2011. http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.918.4342. Accessed 20 Aug 2021.

  40. Dopp AR, Parisi KE, Munson SA, Lyon AR. Aligning implementation and user-centered design strategies to enhance the impact of health services: results from a concept mapping study. Implement Sci Commun. 2020;1:1–13. https://doi.org/10.1186/S43058-020-00020-W.

    Article  Google Scholar 

  41. Pach D, Rogge AA, Wang J, Witt CM. Five Lessons Learned From Randomized Controlled Trials on Mobile Health Interventions: Consensus Procedure on Practical Recommendations for Sustainable Research. JMIR mHealth uHealth. 2021. https://doi.org/10.2196/20630.

    Article  PubMed  PubMed Central  Google Scholar 

  42. Leppla L, Hobelsberger S, Rockstein D, Werlitz V, Pschenitza S, Heidegger P, et al. Implementation Science Meets Software Development to Create eHealth Components for an Integrated Care Model for Allogeneic Stem Cell Transplantation Facilitated by eHealth: The SMILe Study as an Example. J Nurs Scholarsh. 2021;53:35–45. https://doi.org/10.1111/JNU.12621.

    Article  PubMed  Google Scholar 

  43. Dopp AR, Parisi KE, Munson SA, Lyon AR. A glossary of user-centered design strategies for implementation experts. Transl Behav Med. 2019;9:1057–64. https://doi.org/10.1093/TBM/IBY119.

    Article  PubMed  Google Scholar 

  44. Chen E, Neta G, Roberts MC. Complementary approaches to problem solving in healthcare and public health: implementation science and human-centered design. Transl Behav Med. 2021;11:1115–21. https://doi.org/10.1093/TBM/IBAA079.

    Article  PubMed  Google Scholar 

  45. Hohl P, Klünder J, van Bennekum A, Lockard R, Gifford J, Münch J, et al. Back to the future: origins and directions of the “Agile Manifesto” – views of the originators. J Softw Eng Res Dev. 2018;6:1–27. https://doi.org/10.1186/S40411-018-0059-Z.

    Article  Google Scholar 

  46. Matthew-Maich N, Harris L, Ploeg J, Markle-Reid M, Valaitis R, Ibrahim S, et al. Designing, implementing, and evaluating mobile health technologies for managing chronic conditions in older adults: A scoping review. JMIR Mhealth Uhealth. 2016. https://doi.org/10.2196/mhealth.5127.

    Article  PubMed  PubMed Central  Google Scholar 

  47. Walker J, Hashim Y, Oranye N. Impact of Muslim opinion leaders’ training of healthcare providers on the uptake of MNCH services in Northern Nigeria. Glob Public Health. 2019;14:200–13. https://doi.org/10.1080/17441692.2018.1473889.

    Article  PubMed  Google Scholar 

  48. Camara S, Delamou A, Millimouno T, Kourouma K, Ndiaye B, Thiam S. Community response to the Ebola outbreak: Contribution of community-based organisations and community leaders in four health districts in Guinea. Glob Public Health. 2020;15:1767–77. https://doi.org/10.1080/17441692.2020.1789194.

    Article  PubMed  Google Scholar 

  49. Steven V, Deitch J, Dumas E, Gallagher M, Nzau J, Paluku A, et al. “Provide care for everyone please”: engaging community leaders as sexual and reproductive health advocates in North and South Kivu, Democratic Republic of the Congo. Reprod Health. 2019. https://doi.org/10.1186/S12978-019-0764-Z.

    Article  PubMed  PubMed Central  Google Scholar 

  50. Maulik PK, Devarapalli S, Kallakuri S, Tewari A, Chilappagari S, Koschorke M, et al. Evaluation of an anti-stigma campaign related to common mental disorders in rural India: A mixed methods approach. Psychol Med. 2016;47:565–75.

    Article  Google Scholar 

  51. Tewari A, Kallakuri S, Devarapalli S, Peiris D, Patel A, Maulik PK. SMART Mental Health Project: process evaluation to understand the barriers and facilitators for implementation of multifaceted intervention in rural India. Int J Ment Health Syst. 2021;15:15. https://doi.org/10.1186/s13033-021-00438-2.

    Article  PubMed  PubMed Central  Google Scholar 

  52. Constable L, Davidson T, Breeman S, Cotton S, McDonald A, Wileman S, et al. How to deal with a temporary suspension and restarting your trial: our experiences and lessons learnt. Trials. 2020. https://doi.org/10.1186/S13063-020-04705-4.

    Article  PubMed  PubMed Central  Google Scholar 

  53. Mitchell EJ, Ahmed K, Breeman S, Cotton S, Constable L, Ferry G, et al. It is unprecedented: trial management during the COVID-19 pandemic and beyond. Trials. 2020. https://doi.org/10.1186/S13063-020-04711-6.

    Article  PubMed  PubMed Central  Google Scholar 

  54. Bailey C, Black J, Swanton C. Cancer Research: The Lessons to Learn from COVID-19. Cancer Discov. 2020;10:1263–6. https://doi.org/10.1158/2159-8290.CD-20-0823.

    Article  CAS  PubMed  Google Scholar 

  55. Chapter 2:Special Constitutional Provisions for Protection and Development of the Scheduled Castes and Scheduled Tribes. In: National Commission for Scheduled Castes and Scheduled Tribes-Sixth Report. National Commission for Scheduled Castes, Government of India; 2001. p. 8–17. http://ncsc.nic.in/pages/view/295-1999-00-and-2000-01-(english). Accessed 19 Jul 2021.

Download references

Acknowledgements

Not applicable.

Funding

This work was supported by Australian National Health and Medical Research Council (NHMRC) Global Alliances for Chronic Disease Grant (APP1143911). There is no role of the funding body in the design of the study and the conceptualisation and writing of the manuscript.

PKM is partially supported through NHMRC/GACD grant (SMART Mental Health-APP1143911) and UKRI/MRC grant MR/S023224/1—Adolescents' Resilience and Treatment nEeds for Mental health in Indian Slums (ARTEMIS). MD, SD, SKl, AK, AM and DP are partially or wholly supported through the SMART Mental Health NHMRC/GACD grant. DP is supported by fellowships from the National Health and Medical Research Council of Australia (1,143,904) and the Heart Foundation of Australia (101,890). AK is partially supported by Indigo Partnership (MR/R023697/1) award. GT is supported by the National Institute for Health Research (NIHR) Applied Research Collaboration South London at King’s College London NHS Foundation Trust, and by the NIHR Asset Global Health Unit award. The views expressed are those of the author(s) and not necessarily those of the NHS, the NIHR or the Department of Health and Social Care. GT is also supported by the Guy’s and St Thomas’ Charity for the On Trac project (EFT151101), and by the UK Medical Research Council (UKRI) in relation to the Emilia (MR/S001255/1) and Indigo Partnership (MR/R023697/1) awards.

Author information

Authors and Affiliations

  1. The George Institute for Global Health, New Delhi, India

    Ankita Mukherjee, Mercian Daniel, Amanpreet Kaur & Pallab K. Maulik

  2. The George Institute for Global Health, Hyderabad, India

    Siddhardha Devarapalli & Sudha Kallakuri

  3. The George Institute for Global Health, UNSW Sydney, Sydney, Australia

    David Peiris

  4. University of New South Wales, Sydney, Australia

    Pallab K. Maulik

  5. Institute for Health Policy, Management and Evaluation, University of Toronto, Toronto, Canada

    Beverley Essue

  6. Department of Communication, University of Hyderabad, Hyderabad, India

    Usha Raman

  7. Institute of Psychiatry, Psychology and Neuroscience, King’s College London, London, UK

    Graham Thornicroft

  8. Harvard T H Chan School of Public Health, Boston, USA

    Shekhar Saxena

Authors
  1. Ankita Mukherjee
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mercian Daniel
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Amanpreet Kaur
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Siddhardha Devarapalli
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Sudha Kallakuri
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Beverley Essue
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Usha Raman
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Graham Thornicroft
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Shekhar Saxena
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. David Peiris
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Pallab K. Maulik
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

PKM conceptualised the study. AM prepared the initial draft. PKM and DP commented on multiple drafts before sending a prefinal version to everyone listed as authors. All authors provided critical intellectual inputs and comments to the draft. PKM leads the implementation of the trial in India along with MD, SD, SKl, AK and AM. All authors contribute to science or operationalising of the project as co-investigators, or as steering committee members, or researchers helping in the implementation of the trial. Each author has critically reviewed, commented on, and approved the final manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Ankita Mukherjee.

Ethics declarations

Ethics approval and consent to participate

The study received ethics approval from the Independent Ethics Committee of the George Institute, India and the All India Institute of Medical Sciences, New Delhi.

Consent for publication

Not applicable.

Competing interests

The George Institute has a part-owned social enterprise, George Health Enterprises, which has commercial relationships involving digital health innovations.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Mukherjee, A., Daniel, M., Kaur, A. et al. Operational challenges in the pre-intervention phase of a mental health trial in rural India: reflections from SMART Mental Health. Int J Ment Health Syst 16, 42 (2022). https://doi.org/10.1186/s13033-022-00549-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13033-022-00549-4

Keywords

  • cRCT
  • Operational challenges
  • LMIC
  • Mental Health Services
  • Rural
  • India
  • Complex intervention
  • mHealth

International Journal of Mental Health Systems

ISSN: 1752-4458