- Study Protocol
- Open Access
Applying systems approaches to stakeholder and community engagement and knowledge mobilisation in youth mental health system modelling
International Journal of Mental Health Systems volume 16, Article number: 20 (2022)
There is a significant push to change the trajectory of youth mental ill-health and suicide globally. Ensuring that young people have access to services that meet their individual needs and are easily accessible is a priority. Genuine stakeholder engagement in mental health system design is critical to ensure that system strengthening is likely to be successful within these complex environments. There is limited literature describing engagement processes undertaken by research teams in mental health program implementation and planning. This protocol describes the methods that will be used to engage local communities using systems science methods to mobilize knowledge and action to strengthen youth mental health services.
Using participatory action research principles, the research team will actively engage with local communities to ensure genuine user-led participatory systems modelling processes and enhance knowledge mobilisation within research sites. Ensuring that culturally diverse and Aboriginal and Torres Strait Islander community voices are included will support this process. A rigorous site selection process will be undertaken to ensure that the community is committed and has capacity to actively engage in the research activities. Stakeholder engagement commences from the site selection process with the aim to build trust between researchers and key stakeholders. The research team will establish a variety of engagement resources and make opportunities available to each site depending on their local context, needs and audiences they wish to target during the process.
This protocol describes the inclusive community engagement and knowledge mobilization process for the Right care, first time, where you live research Program. This Program will use an iterative and adaptive approach that considers the social, economic, and political context of each community and attempts to maximise research engagement. A theoretical framework for applying systems approaches to knowledge mobilization that is flexible will enable the implementation of a participatory action research approach. This protocol commits to a rigorous and genuine stakeholder engagement process that can be applied in mental health research implementation.
Globally, the magnitude of the burden of mental illness and its associated adverse human, economic and social impacts has been well described [3, 4]. In Australia, mental illness is the largest single cause of disability, with as many as one in five people aged 16–85 years experiencing a mental illness in any one year . While mental illness across the life-course requires attention, more than half of the mental illness experienced in adult life has its onset in childhood or adolescence . This has important implications for social, family, educational and vocational trajectories and, for the longer term economic and social future of the Australian community. However, best approaches for achieving improved system design, system strengthening, and resource allocation to improve youth mental health outcomes are unclear.
The need to understand and respond effectively to regional variation in the characteristics and drivers of mental ill-health, including suicidal behavior, across Australia was a major factor in the establishment of 31 Primary Health Networks (PHNs) in 2015 . These not-for-profit organisations have responsibilities to undertake needs analysis, planning, coordination and commissioning of primary health care services and supports across their designated region. Although PHNs do not directly deliver services, they are funded to commission local service providers to deliver initiatives, including mental health and suicide prevention programs, in accordance with local population needs, contexts and priorities, as well as fostering critical collaboration among local stakeholders in their regions.
Genuine stakeholder engagement in mental health research
User-led research and underpinning participatory research methods can lead to improved stakeholder engagement and active involvement in priority setting, knowledge mobilization (KM) and dissemination . Mental health programs are typically implemented in complex environments where services can be fragmented, agencies have competing health priorities, limited funding and infrastructure, and unexpected crises such as political instability, natural disasters, and pandemics can be disruptive . Such complex environments pose greater challenges in the implementation of mental health research programs. Therefore, stakeholder engagement is increasingly recognized as vital to successful and sustainable program implementation [10,11,12]. Despite such importance, there has been a clear lack of literature and research detailing the processes of stakeholder engagement in national and global mental health initiatives. Genuine stakeholder engagement affords stakeholders a place at the table, including them in the decision-making process, allowing them to hear plans, have a voice and actively contribute . If stakeholders are permitted to advise, but researchers retain the ultimate decision-making power, this will lead to superficial or tokenistic, rather than meaningful stakeholder engagement [14, 15]. Therefore, an intentional partnership between researchers and stakeholders are both important to enable successful implementation of mental health programs [14, 15]. In the context of this research Program, genuine engagement means having flexible implementation strategies (described later) to be adaptive to stakeholder needs and facilitate active participation of a range of people . Such engagement with service-users and community members from the commencement of research and implementation planning, can promote the needs and feasibility of research program objectives .
Knowledge mobilization through a participatory system modelling process
Knowledge mobilization (KM) refers to the activities and approaches used to create and share research-informed knowledge . Many terms are used to describe this process (e.g., knowledge translation or research to practice/action) however, the term KM was chosen for this protocol as it acknowledges that the process is emergent, multi-directional, complex, highly relational and context dependent [18, 19].
The potential for systems thinking and systems science methods to complement and strengthen KM approaches for complex health issues is increasingly recognized [19,20,21,22,23]. Systems approaches, including participatory systems modelling can assist in elucidating the behavior of complex problems, such as youth mental ill-health, and inform efforts to address them [24,25,26]. Systems approaches recognize that these challenging health issues occur within complex systems that are dynamic, interdependent, and evolving which need to be better understood to make positive, impactful change [26,27,28]. Haynes and colleagues articulate a theoretical framework that combines systems approaches and KM archetypes (groupings of KM activities) and recognizes the complexity and unpredictability of working within systems, such as mental health systems .
The utilization of a participatory systems modelling approach and KM archetypes as a theoretical framework facilitates a disciplined approach to stakeholder engagement for large-scale national mental health implementation programs. KM can be deployed as a critical strategy to improve health policy and practice, whereby the application of systems thinking and participatory modelling can be utilized to improve KM . It is important to note that participatory action research (PAR) approaches and specific adaptations of PAR principles have been developed to address Indigenous research contexts. However, it should also be recognized that large national mental health programs will generally be poorly suited to Aboriginal and Torres Strait Islander people. This recognises the effects of colonization and ongoing social exclusion and the need for Indigenous knowledge to be developed by Aboriginal and Torres Strait Islander communities and people themselves. Therefore, a distinctive Aboriginal PAR (APAR) approach has been proposed by Dudgeon and colleagues .
Implementation that is adaptive, contextual, and reflexive
Our program of research recognizes an approach that will apply participatory systems modelling (capturing the broader social drivers of youth mental health issues), digital infrastructure, and service innovation to develop a scalable and sustainable blueprint for broader national and international applications [1, 2]. This also requires a PAR approach which is a well-established research methodology, typically adopted when there is a need for action to address an inequitable situation . It is often described as a reflexive cycle requiring gathering and reflecting as a group, planning action and inquiry, acting, observing and recording and returning to reflect further . Researchers should approach PAR with humility, openness to learning and respect for participants’ own perspectives and expertise relevant to KM . Previously, our research has used participatory modelling as a KM tool in Australian policy settings, whereby participatory methods placed stakeholders at the center of the process . The process enables co-production of knowledge, facilitates transparency and confidence in model outputs to inform policy and program decisions [18, 33].
Principles for working in a culturally responsive way with Aboriginal and Torres Strait Islander communities, to support mental health and wellbeing, have been articulated by leaders in this field . Aboriginal and Torres Strait Islander communities and people experience psychological distress at higher rates than other Australians, and the suicide rate among Aboriginal and Torres Strait Islander children and youth is around four times higher . Explanations for this disparity centre on intergenerational trauma and the continuing experience of colonizing practices and attitudes, which undermine protective factors in Aboriginal and Torres Strait Islander cultures and communities. Therefore, it is essential that engagement with Aboriginal and Torres Strait Islander people is empowering and respectful of their strengths, capacities, and leadership. PAR approaches mirror Aboriginal and Torres Strait Islander community capacity-building practice , and may be appropriate for working with Indigenous communities provided they are sufficiently flexible to accommodate fundamental differences in perspective; for example the Aboriginal and Torres Strait Islander concept of social and emotional wellbeing  encompasses a broader, more holistic perspective than the Western notion of mental health and mental illness. An Aboriginal PAR approach recognises cultural differences and the need to acknowledge and facilitate the development of specific Indigenous knowledges by Aboriginal and Torres Strait Islander communities and people. It also recognises that the service systems surrounding Aboriginal and Torres Strait Islander community groups are likely to be experienced differently in terms of historical and institutional racism, and/or they may be culturally inappropriate.
Aims and objectives
This methods protocol describes the site and stakeholder engagement process to be implemented in the Right care, first time, where you live Program (the Program; see Box 1). The Program will engage with youth mental health system stakeholders in multiple Australian sites to provide decision support tools that are contextualized for each local community . The Program aims to embed shared decision-making from commencement to completion and to facilitate the inclusion of diverse voices, particularly the voices of those with lived experience, their carers and Aboriginal and Torres Strait Islander people. These important groups have traditionally been limited in power when decision-making authority is shared with other stakeholders such as hospital system leads, health network leadership groups and academic researchers . To support this aim, our program of work will make every effort to align and adapt the Program with the site and stakeholder’s institutional norms and existing practices . This protocol has contributions from key stakeholders, aiming to facilitate a shared understanding of the approach used, to engage with stakeholders and communities in the Right care, first time, where you live research Program.
The importance of community engagement in research has been increasingly highlighted due to the concern of communities being harmed or exploited, particularly in developing countries and Aboriginal and Torres Strait Islander communities . An effective community engagement framework has been proposed by Lavery and colleagues to articulate twelve points to consider and to avoid potential exploitation by researchers [6, 9, 40, 41]. We have adopted this engagement framework for our research Program (refer to Fig. 1) and established four phases to include: (1) site selection and capacity to participate; (2) establishing relationships and building trust; (3) committing to meaningful engagement (researchers); and (4) committing to the process (stakeholders).
Phase 1: site selection and capacity to participate
A rigorous site selection process is vital in determining whether sites and their communities have the motivation and capacity to be active participants in community-based research . The chosen sites will also operate across different states and territories and differences in state-based health service provision will be considered. The implementation plan for this Program will be phased across two sites each year in urban, outer-urban, regional and rural-remote regions. A total of eight sites will be selected to capture variation in:
Key demographic factors such as socio-economic status (SES), education and employment status (focus on lower SES, education completion and employment);
At least two sites (including urban/outer urban and regional/rural) specifically including a high proportion of persons who identify as Aboriginal and/or Torres Strait Islander and have significant health service organisations that are controlled and operated by the Aboriginal and/or Torres Strait Islander community
Other demographic diversity factors (i.e., percent born overseas, culture, language at home other than English) that increase risk of mental ill-health or poor access to quality care; and,
Diversity of existing health services infrastructure and community resources.
This approach will permit comparison of the factors that drive successful implementation of the systems modelling, monitoring, evaluation, and clinical service capacity building infrastructure in diverse settings. One of the most consistent findings from clinical and health services research is the failure of mobilizing research findings into practice and policy. Therefore, KM must be planned and implemented as an early and intentional approach .
It has been recommended that early initiation of engagement at the site selection process avoids pressing sites, when decision-makers are under pressure, to make rushed and ill-considered decisions purely to meet the timelines of researchers . As a first step, expressions of interest will be sought from all potential sites that are interested in participating in the research Program. These sites would typically be the PHNs, that are responsible for regional suicide prevention service planning and commissioning. Sites will be provided a period of four weeks to express their interest in research participation. Following this, potential other sites will be invited based on which geographic locations needed to be filled remaining from the initial expressions of interest. A planning process is vital for implementation projects that seek engagement of multiple stakeholders to identify and address gaps that are needed to improve system effectiveness and efficiency . This process will assist the identification of the appropriate administrative authority and relevant community stakeholders to ensure perspectives are sought through the early stages of the Program. This is likely to be especially important in the case of Aboriginal and Torres Strait Islander stakeholders and communities, where there may be a history of distrust of mainstream health authorities linked to experiences of discrimination . Where these exist, local Aboriginal and Torres Strait Islander community-controlled organisations should always be invited.
The goals of the research in addition to other information necessary to the site will be actively shared using plain language, as meaning can be easily lost in the complexities of scientific jargon. Using accessible language will enable framing and justifying the relevance of research activities. Our previous health service research has also shown that the involvement of a local champion was a key facilitator of successful implementation . Such local champions are not necessarily based on status but often earned and maintained by the individual’s competence, social accessibility, and conformity to the system’s norms . The local champions will be influential in their health system’s communication structure and therefore, will likely have interpersonal and social networks that will engage with the knowledge, attitudes, and social norms of the target groups of the Program.
Following the initial meeting, a follow-up meeting with the site will be conducted to ensure that adequate information dissemination was provided by the research team to the site. As part of the rigorous site selection process, the meetings will enable the collection of specific information about the site to ensure sites are assessed for research implementation feasibility in a consistent and transparent way. An internal checklist by researchers will then be used to assess a site’s capacity in relation to the research Program goals and activities, including: co-design requirements and ethics approvals, governance frameworks, mental health needs and urgency, and cultural competency and Aboriginal and Torres Strait Islander governance (Table 1). This will then be followed by a feasibility meeting hosted by the research team to discuss the unique context and characteristics of the site that will enable feasibility of participation and also identify the barriers and facilitators of site participation. The sites are informed of the outcome of the site selection process.
Phase 2: establishing relationships and building trust
Establishing effective partnerships is key to successful implementation of participatory systems modelling projects. Early engagement with each site is important to ensure that the modelling will address their decision analysis needs. These discussions will help scope the systems model without changing the primary research question and overarching purpose of the work. Therefore, three site visits will be planned prior to implementation, to enable preparation to allow for a genuine and trust-building process between the researchers and the key stakeholders of the site (Table 2).
Site visit 1: leadership team (refer to Additional file 1: Appendix S1)
This is the first face to face meeting with the site and used to build rapport and trust with the site and their local champion. The research team prior to the visit ensures that attendees from the site are those that will be the key leadership stakeholders for the site, to ensure optimal implementation and championing of the Program. The scoping of the mental health needs, stakeholder networks, pressure points and political landscape will facilitate the identification of key decision-makers for the site and its region. The site will be asked to start early discussions with key stakeholders that will need to be present at Site Visit 2. Further, if there are key organisations that the research team could meet with at Site Visit 2, they can be identified at this visit.
The best methods of community engagement to advocate for the Program and engage with broader members of the community will be determined and identified by the site. The research team acknowledges that each site has its own specific mechanism of optimally engaging with the community, and therefore a specific community engagement plan that is adaptive and contextual will be developed collaboratively with the site. Funding will be allocated to all sites for community engagement purposes and to support a local community champion to work collaboratively with the research team. The research agreements that need to be reviewed will be discussed at this site visit to ensure there is ample time for review and execution prior to the implementation phase. This will also facilitate early and reciprocal understanding of research Program expectations to be explored and reviewed.
Site visit 2: operational team (refer to Additional file 2: Appendix S2)
This visit is critical to establish and discuss the mental health challenges for the local context and the priority mental health needs for the community. Site delegates will be encouraged to speak directly about some of the contextual issues and any other commissioning priorities that will impact or complement the Program. The stakeholder group that will be participating in the implementation process will be confirmed by the site and the proposed roles and expectations during the participatory process will be discussed. Further, the evaluation approach for the participatory modelling process will be discussed including how the recruitment approach will be established. The overall approach of the economic analysis will also be discussed, including the identification of key datasets.
Site visit 3: technical team (refer to Additional file 3: Appendix S3)
Key stakeholders that were identified in Site visit 2 will be invited to attend, including the data specialists from the site. The participatory systems modelling preparation will be discussed in detail, including model scope, data requirements, decision support priorities, interventions and outcomes that are likely to be prioritised by local stakeholders. Identified key stakeholders invited to the implementation process will be confirmed, including the identification of superusers of the systems modelling for the site. Superusers are local stakeholders with interest and capacity to be trained by the research team to interact with the systems model developed for the site and interpret findings. The research team’s systems modeller will present key data preparation requirements primarily by providing shell tables for completion and discuss any site-specific data needs. Data shell tables will be contextualised based on how the models will need to be stratified for each region.
Phase 3: committing to meaningful engagement (researchers)
This research Program aims to enable commitment by the research team to maintain sustainable and genuine partnerships with the sites and their communities. An advocacy plan for this research Program has been co-designed with lived experience participants and will be mapped against the objectives of the Program, focusing on awareness, engagement, and integration.
Community engagement strategy
A community engagement strategy will be deployed to support the research team’s commitment to meaningfully engage with the community and to initiate community engagement activities early. This will result in increased opportunities for KM in this Program . The types of engagement opportunities will be discussed collaboratively  with each site and the research team working together to arrive at the optimal strategy that meets the site and their community’s needs. A variety of different approaches will be applied by the research team to build awareness, engagement, and integration with the community, based on local needs, desires, and resources available . The collaborative consultation with sites is critical in discussing optimal dissemination methods through social media, podcasts, surveys, and consistent messaging to the local community [46, 47].
Social media offers significant opportunities to expand the reach and engagement of health messages . Social media platforms including Twitter, Instagram and YouTube will be used to engage with each sites’ local community. The use of tagging and hashtags will also be deployed to allow the research team to engage not only with the local community at each site, but also to disseminate to a wider community nationally and internationally. Increasingly, podcasts have been considered a successful mechanism to disseminate information, particularly research information, and normalise academic experiences . We have partnered with a youth lived experience podcast to capture the journey each site will undertake through the implementation phase of the research and disseminate this to the community. The podcast programming will focus on speaking with and learning alongside expert participants and young people from each site to embed and document their voice and community knowledge.
A brand is a valuable asset as it provides a means for consumers to recognise and specify a particular offering, should they wish to choose it or recommend it to others . Program resources have been developed for each site to utilise and ensure that the awareness of the objectives and aims of the Program are delivered in a consistent manner to the public, community and relevant regional, state and national agencies. These include:
Program logo to depict the participation of many different community members for one common goal;
Infographics to highlight the messaging in the logo and bring a consistent colour pallet and feel to the Program;
Videography to capture each community story (a ‘video diary’) which will continue to be developed across the lifecycle of the Program and will be used to engage communities, record workshop progress and explain the Program to the community in a succinct, informative and emotive way; and
A Program information flyer will be developed as an engagement tool that sites can utilise to increase participation of expert stakeholders to the workshops through existing local alliances .
Community capacity building
Successful community engagement ensures the community benefits from the research (e.g., learning new skills or refining knowledge) . The research Program will enable opportunities for increasing community and policy maker understanding, building capacity and KM. Superuser training is one of the measures to ensure sustainable continuation the Program beyond the implementation timeframe. This training will upskill nominated persons from within decision making and/or primary partner agencies who will be supported to build systems modelling knowledge in how to use and interpret findings from the systems model developed for their community. Following this interactive training the superusers will have competency in using the model to explore policy scenarios, and interpret and describe modelling findings in reports, policy briefs, business cases, and to support community advocacy even after the research Program is completed . The research team will provide an ‘Insights Brief’ that will showcase the key findings and insights from the systems modelling process, including an explanation of the results. This will serve as the main communication output provided to sites and key stakeholders to support advocacy for changes or upscaling of service provision within their community.
The identification of local champions to support and translate the messages emerging from the Program in each local area will ensure the workshop findings can reach those not traditionally engaged in heath messaging and planning addressing health information inequality [43, 48]. The research team will fund and engage with a local champion to facilitate optimal engagement with the local decision makers, those who will benefit from service changes and improvements and community members who support others to navigate service structures. They will engage with their broader community to facilitate contributions to the modelling beyond the workshop participants and will disseminate findings that have emerged from the systems modelling workshops to the community. This wider engagement with the community will assist in building community confidence not only in the results but also give opportunity for the research team to hear from a diverse range of mental health voices across the community [53, 54].
Working with Aboriginal and Torres Strait Islander people
Where there is an Aboriginal and Torres Strait Islander population focus, this Program will seek to develop genuine partnerships and inclusion. For example, community members will be offered employment opportunities and included in governance processes for the site, while local community-controlled organisations will be invited to advise about appropriate people and organisations to participate in consultation and co-design processes. It is essential to recognise the central role of culture, community, and Country in social and emotional wellbeing, and how these ideas differ from Western concepts of mental health and illness . Processes that support self-determination and cultural inclusion are also essential. The approaches to working with Aboriginal and Torres Strait Islander people and communities in this Program are informed by the literature and the author’s experiences implementing previous projects [29, 34].
Respect for Aboriginal and Torres Strait Islander governance:
There is a strong commitment to building relationships of trust with Elders and community leaders and members that will sustain the Program and ensure the systems modelling addresses community priorities. This includes commitments: to be open and transparent about Program objectives, intentions and actions; to recognise the expertise that people share, including by compensating them appropriately; and to support community capacity building.
It is important to work under the leadership and governance of Aboriginal and Torres Strait Islander communities and organisations, recognising that self-determination and decision-making autonomy are core foundations of effective suicide prevention for Aboriginal and Torres Strait Islander people.
Local protocols will be observed, including ensuring all major meetings are opened by a community Elder and include a Welcome to Country, and meeting and consultation arrangements take account of cultural protocols as required.
Working with local Elders and community members, the Program is committed to the full inclusion of Aboriginal and Torres Strait Islander people, valuing and supporting their human rights and cultural differences.
Recognising that people’s culture and life experiences may require alternative consultation approaches, the Program will be open to flexible ways of meeting and decision-making, including yarning circles and spontaneous conversations at the request of the community. Time and space will always be made available for people to express their experiences and knowledges and what is most important to them .
The loss of young people to suicide is common in Aboriginal and Torres Strait Islander communities . In meetings where suicide is discussed, people may express grief and trauma, as well as anger about their experiences with health systems and institutions, and it is important to respectfully listen.
The Program will support communities’ own understanding of mental health and/or distress, and not impose clinical or other external models.
Consultations and communications will use strength-based language anchored in positive concepts of social and emotional wellbeing, avoiding academic and bureaucratic language that might exclude Aboriginal and Torres Strait Islander people.
The Program recognises the importance of the role of culture in social and emotional wellbeing, including traditional healing practices and reconnection to Country and cultural practices .
Working with people with lived experience
Consumer and carer contributions and inclusion will be routine practice throughout the research activities involved in the Program . People with lived experience of mental ill-health will be included both as stakeholders in the research and as members of the research team. Supporting an inclusive culture may involve allowing additional time for consumers and carers with the research team to clarify concepts and explain the systems model and engage with the user interface of the systems model that will be developed for each site. The practical strategies to support inclusion of people with lived experience of mental ill-health and their carers in this collaborative process include being conscious of language, providing a safe and supportive environment, facilitating access, and ensuring diversity in lived experience and cultural background. The procedures for working with people with lived experience in this study are informed by the literature [57,58,59,60,61,62,63,64], including the best practice principles for supporting consumer and carer participation in mental health research described by the National Mental Health Commission  and the authors’ experiences implementing previous projects in the mental health sector.
Language use and word choice has a significant impact on all people. This is particularly applicable in individuals with lived/living experience of mental ill-health as a result of significant disadvantage, trauma, poverty, physical health quality, and stigma.
It will be critical to ensure that choice in words and language used throughout the Program are inclusive and respectful and do not lead to further disadvantage and/or social exclusion.
Language use should aim to be age-appropriate, respectful, non-judgemental, jargon free and accessible to any individual no matter their socio-economic and/or education background.
The language should be person-centred i.e., ‘person with mental ill-health’ rather than ‘they are mentally ill’, and recovery oriented, conveying the potential for hope and opportunity.
Communication should always be strengths focused rather than limitations focussed whilst being sincere. The Mental Health Coordinating Council provides an extensive and practical guide for using Recovery Oriented Language .
Safe and supportive environment:
Safe engagement means that appropriate supports are available for anyone, not just people with lived experience of mental ill-health, to engage in the research.
Practically, this may include being explicit about workshop guidelines/protocol for safe and acceptable disclosure, ensuring that participating individuals have access to and are aware of supports available (e.g., debriefing, referral to professional support, allowing people to take breaks when needed, observing levels of psychological distress within the group, checking in with participants, and offering support where appropriate).
Workshop facilitators and support staff will ensure that large and small group discussions are respectful and inclusive for all participating individuals (e.g., valuing contributions from all participants, minimising instances where people are interrupted, cut off, or not listened too and minimising the use of jargon).
Informal conversations during breaks, and outside of workshops, can be used to facilitate further engagement opportunities and encourage participation in the process by providing additional information, clarification, and context to the collaborative modelling process, method, and contribution opportunities outside of the formal workshop process (e.g., sharing stories and experiences of mental health system in direct one-on-one conversation with the modelling team member/s).
Facilitating access and ensuring diversity:
The choice of location, venue, and timing for workshops will need to consider the needs of participating individuals (e.g., transportation, standard mealtimes, and any community-specific commitments).
Barriers to participation can include distance and travel-times; environmental barriers also include individual requirements such as mobility access, physical space for ‘time-out’ breaks during workshops, dietary needs, and allowing sufficient time for participants to prepare for workshops (including organising of other commitments).
Ensuring diversity means including and valuing contributions from people with varying cultural backgrounds (this includes their supportive others).
Phase 4: committing to the process (stakeholders)
Collaborative and genuine partnerships are developed and sustained when the constituent members contribute their perspectives, resources, and skills creating an opportunity for research synergy, allowing the partnership to obtain outcomes that no one constituent member could have produced on their own . To enable this in the context of this Program, engagement of sites must be conducted in a sustainable way to build partnerships that strengthen their communities. Implementation research shows there are four key constructs to consider when engaging multilevel stakeholders in the research process :
Commitment of stakeholders to the process and the goals of the project;
Capacity of stakeholder to participate in the process and engage in research activities;
Commitment of researchers to meaningfully engage stakeholders; and
Trust among researchers and stakeholders.
Although eight sites will be initiated at differing timepoints, the Program will aim to ensure all sites and the research team continue learning from each other throughout the timeline of the Program. There is a critical difference between going through the empty ritual of obtaining stakeholder feedback and genuinely providing stakeholders the real power needed to affect the research process and resulting outcomes . Further, if these relationships are established early, greater trust can be built with communities . The participating eight sites will be invited to annual symposiums to ensure that all sites are considered key participants throughout the Program. The symposiums will be an opportunity to share experiences and celebrate milestones; identify anticipated and unanticipated outcomes; incorporate key lessons; and consider optimization of Program delivery and progress.
Analysis: theoretical approach to guide the participatory action research (PAR)
The theoretical model for applying systems approaches to KM processes described by Haynes et al.  will be adopted as a framework to inform stakeholder engagement strategies and KM methods for our research. The model outlines how systems thinking concepts, including leverage points to target, intersect with KM archetypes  and how they can be applied in practice to guide engagement strategies. Three KM archetypes have been identified as particularly relevant in the context of this Program of research, and they are: producing and disseminating knowledge; researching in practice; and fostering networks. For this research, an additional domain has been applied that focuses on working with Aboriginal and Torres Strait Islander communities.
The framework  outlines a hierarchy of leverage points for effecting change in complex systems ranging from elements, e.g., resources or practices, to structure and rules, to system paradigms [26, 66, 67]. Change is harder to achieve at higher levels of the hierarchy i.e., paradigm shift, however, when change is successful at this level it is more likely to be transformational . When applied to stakeholder engagement and KM strategies for this research, each community engagement site is viewed as its own complex system and will be analysed to determine the change levers that are available and the strategies that may support effective KM and positive system change. The practical strategies for applying a systems approach to stakeholder engagement and mobilizing knowledge in the Right care, first time, where you live Program are described in Table 3.
It is important to note that the Program will need to take account of the current policy directions, expenditure priorities and accountability mechanisms that have been put in place by both federal and state governments and consider how these impact on both the local system and the implementation of this Program. Their impact may be supportive of positive changes in the system or they may create barriers to progress. Regardless, there are likely to be “pressure points” that are contextual for each local site and will result in decisions and judgements needing to be made and compromises sought. In this context, it will be critical to be consistently alert to both the research team’s own values and biases and the values and biases of the stakeholders who participate in the Program .
As detailed in Program’s evaluation protocol , and to ensure a transfer of learnings and research quality assurance process, a PAR approach will be embedded to draw insights from the evaluation process through reflective research team discussions at key time points in the project e.g., following each site visit and participatory workshop. This process will seek to highlight the importance of having a disciplined but adaptive approach to site and stakeholder engagement when conducting research with health services. Internal team reflective discussions will be recorded for qualitative analysis opportunities and transfer of learnings. Based on the theoretical framework described above and the practical strategies outlined in Table 3, key questions will be discussed by the research team at key time points will include:
What strategies/actions are we putting in place to impact as many system leverage points as we can?
How are the system leverage points being implemented?
Do we need to change/modify strategies?
Are there gaps in what we are doing i.e., leverage opportunities that we are missing?
Are we ensuring the contributions of different stakeholder groups are balanced? e.g., young people with lived experience of mental ill-health.
Over 20 years in Australia, there have been five national mental health plans, and the urging of transparent strategies to implement accountabilities of such national plans, including the challenges arising from funding insecurity and resource allocation [69, 70]. Mental health services in Australia are plagued by service fragmentation and, while there is growing recognition of the importance of co-designing policies and services with people who will use them, this is limited in practice . There are few examples of rigorous, co-designed implementation plans that are intended to address the inequities of distribution in the availability of mental health resources . These services are incorporated into various, local human service systems and therefore, it is vital for multiple levels of stakeholders to be included in decision-making to enable system strengthening and research implementation design processes to inform it . A greater understanding of different stakeholder perspectives may lead to improved collaboration to enhance health services and service delivery . This protocol outlines our commitment to meaningful stakeholder engagement by using reflective KM and systems science approaches to support active participation in the research and enabling shared decision-making that respects diverse needs, perspectives, and interests.
The research Program will be implemented across various geographically and demographically diverse regions across Australia and includes regions with high populations of Aboriginal and Torres Strait Islander people. The process of stakeholder engagement will be iterative and flexible to accommodate the needs of the different communities and contexts  and support the engagement and inclusion of diverse stakeholder voices. Implementation of innovative research Programs like Right care, first time, where you live requires the consideration of multiple points of leverage and contexts that factor into the social, organisational, economic and political context of each community . Therefore, input from various stakeholders that represent these different contexts are vital to address any implementation challenges that may require research Programs to be adaptive, to enable positive and sustained implementation . This research draws on a theoretical framework for applying systems approaches to knowledge mobilisation that is flexible and can guide implementation approaches to accommodate the needs of participants  and the PAR approach. When engaging with communities with a high proportion of Aboriginal and Torres Strait Islander people, the approach will be guided by the specifically adapted APAR methodology previously published .
Stakeholder engagement initiated in the early stages of research can support the translation and interpretation of findings and is likely to accelerate the actionability of research outcomes [74, 75]. There is growing interest in and demand for research that focuses on stakeholder engagement, as it can facilitate the reorientation and improvement of research implementation, reduce uncertainties, accelerate the adoption of meaningful findings, and ultimately improves decision-making processes and health outcomes . However, despite this growing interest there is limited evidence on the demonstrated value of research engagement with stakeholders and the KM such engagement could enable. Therefore, documentation and correspondence of clear objectives and shared vision of the research Program with stakeholders must take place early and throughout the research process. This also requires consistent communication with stakeholders to reconfirm priorities as efforts and interest on common goals can wane . Initiating engagement early and taking the time to develop shared vision and reciprocity is vital to fostering trusting relationships with stakeholders . The research protocol utilises a period of one year prior to implementation, to acknowledge early and sustained stakeholder engagement will facilitate the KM required to enable maximal research and community outcomes.
This protocol outlines an applied approach to engage youth mental health system stakeholders in a participatory systems modelling and digitally-enhanced care multi-site research Program. The Program aims to develop and provide enhanced system level decision support methods that are contextualised for diverse communities. The practical and theoretical approach to stakeholder engagement is described in this protocol to openly articulate the values and intended approach of the researchers in undertaking this research. The protocol also provides an example of how rigorous stakeholder engagement can be undertaken in mental health service research that can be used and further developed by researchers.
Availability of data and materials
Brain and mind centre
Culturally and linguistically diverse
Organisation for Economic Co-operation and Development
Participatory action research
Primary health networks
Occhipinti J-A, Skinner A, Freebairn L, Song YJC, Ho N, Lawson K, et al. Which social, economic, and health sector strategies will deliver the greatest impacts for youth mental health and suicide prevention? Protocol for an advanced, systems modelling approach. Front Psychiatry. 2021;12:759343.
Freebairn L, Occhipinti J-A, Song YJC, Lawson K, Skinner A, Lee GY, et al. Participatory methods for systems modelling of youth mental health: an implementation protocol. JMIR Res Protoc. 2022. https://doi.org/10.2196/32988.
Australian Bureau of Statistics. National survey of mental health and wellbeing: summary of results, 4326.0, 2007. Canberra, ABS; 2008.
Whiteford HAP, Degenhardt LP, Rehm JP, Baxter AJ, Ferrari AJB, Erskine HEB, et al. Global burden of disease attributable to mental and substance use disorders: findings from the Global Burden of Disease Study 2010. Lancet. 2013;382(9904):1575–86.
Lee GY, Hickie IB, Occhipinti J-A, Song YJC, Camacho S, Skinner A, et al. Participatory systems modelling for youth mental health: an evaluation study applying a comprehensive multi-scale framework. JMIR Res Protoc. 2022. https://doi.org/10.2196/32988.
Australian Institute of Health and Welfare. Mental health services: In brief 2018 Canberra: AIHW; 2018.
Kessler RC, Berglund P, Demler O, Jin R, Merikangas KR, Walters EE. Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the national comorbidity survey replication. Arch Gen Psychiatry. 2005;62(6):593–602.
Australian Government Department of Health. Australian Government response to contributing lives, thriving communities—review of mental health programmes and services. Canberra; 2015.
Murphy J, Qureshi O, Endale T, Esponda GM, Pathare S, Eaton J, et al. Barriers and drivers to stakeholder engagement in global mental health projects. Int J Ment Health Syst. 2021;15(1):30.
Grimshaw JM, Eccles MP, Lavis JN, Hill SJ, Squires JE. Knowledge translation of research findings. Implement Sci. 2012;7(1):50.
Zerhouni EA. Translational and clinical science—time for a new vision. N Engl J Med. 2005;353(15):1621–3.
Feldstein AC, Glasgow RE. A practical, robust implementation and sustainability model (PRISM) for integrating research findings into practice. Jt Comm J Qual Patient Saf. 2008;34(4):228–43.
Goodman MS, Sanders Thompson VL. The science of stakeholder engagement in research: classification, implementation, and evaluation. Transl Behav Med. 2017;7(3):486–91.
Banfield MA, Morse AR, Gulliver A, Griffiths KM. Mental health research priorities in Australia: a consumer and carer agenda. Health Res Policy Syst. 2018;16(1):1–11.
Moghaddam FM. The SAGE encyclopedia of political behavior. Thousand Oaks: SAGE Publications; 2017.
Belkin GS, Unützer J, Kessler RC, Verdeli H, Raviola GJ, Sachs K, et al. Scaling up for the “bottom billion”: “5 x 5” implementation of community mental health care in low-income regions. Psychiatric Serv. 2011;62(12):1494–502.
Davies HTO, Powell AE, Nutley SM. Mobilising knowledge to improve UK health care: learning from other countries and other sectors—a multimethod mapping study. Health Serv Deliv Res. 2015;3(27):1–190.
Freebairn L, Rychetnik L, Atkinson J-A, Kelly P, McDonnell G, Roberts N, et al. Knowledge mobilisation for policy development: implementing systems approaches through participatory dynamic simulation modelling. Health Res Policy Syst. 2017;15(1):83.
Haynes A, Rychetnik L, Finegood D, Irving M, Freebairn L, Hawe P. Applying systems thinking to knowledge mobilisation in public health. Health Res Policy Syst. 2020;18(1):1–134.
Holmes BJ, Best A, Davies H, Hunter D, Kelly MP, Marshall M, et al. Mobilising knowledge in complex health systems: a call to action. Evid Policy. 2017;13(3):539–60.
Smith KE, Joyce KE. Capturing complex realities: understanding efforts to achieve evidence-based policy and practice in public health. Evid Policy. 2012;8(1):57–78.
Finegood D, Holmes B. Practical strategies to mobilise knowledge in complex systems, Sydney. 2017. https://www.youtube.com/watch?v=klkZBkw7eiA&feature=youtu.be. Accessed 5 Jun 2019.
Leischow SJP, Best AP, Trochim WMP, Clark PIPM, Gallagher RSBS, Marcus SEP, et al. Systems thinking to improve the public’s health. Am J Prev Med. 2008;35(2):S196–203.
Luke DA, Stamatakis KA. Systems science methods in public health: dynamics, networks, and agents. Annu Rev Public Health. 2012;33(1):357–76.
Mabry PL, Marcus SE, Clark PI, Leischow SJ, Méndez D. Systems science: a revolution in public health policy research. Am J Public Health. 2010;100(7):1161–3.
Meadows DH. Leverage points: places to intervene in a system. Hartland: The Sustainability Institute; 1999.
Sterman JD. Learning from evidence in a complex world. Am J Public Health. 2006;96(3):505–14.
Best A, Holmes B. Systems thinking, knowledge and action: towards better models and methods. Evid Policy. 2010. https://doi.org/10.1332/174426410X502284.
Dudgeon P, Bray A, Darlaston-Jones D, Walker R. Aboriginal participatory action research: an indigenous research methodology strengthening decolonisation and social and emotional wellbeing. Discussion Paper. Lowitja Institute; 2020.
Kidd S, Davidson L, Frederick T, Kral MJ. Reflecting on participatory, action-oriented research methods in community psychology: progress, problems, and paths forward. Am J Community Psychol. 2018;61(1–2):76–87.
Kemmis S, McTaggart R, Nixon R. The action research planner: doing critical participatory action research. Singapore: Springer; 2014.
Rahman A. Action and knowledge: breaking the monopoly with participatory action research. New York: Apex Press; 1991.
Freebairn L, Atkinson J-A, Kelly PM, McDonnell G, Rychetnik L. Decision makers’ experience of participatory dynamic simulation modelling: methods for public health policy. BMC Med Inform Decis Mak. 2018;18(1):131.
Dudgeon P, Cox A, Walker R, Calma T, Milroy J, Ring I, Georgatos G, Holland C, Luxford Y. Solutions that work: what the evidence of our people tell us: Aboriginal and Torres Strait Islander suicide prevention evaluation report. School of Indigenous Studies, UWA. November 2016.
ABS. Intentional self-harm in Aboriginal and Torres Strait Islander people: ABS. 2019. https://www.abs.gov.au/articles/intentional-self-harm-aboriginal-and-torres-strait-islander-people. Accessed 20 Feb 2022.
Dudgeon P, Milroy H, Walker R, Calma T. Working together: Aboriginal and Torres Strait Islander mental health and wellbeing principles and practice. 2nd ed. West Perth: Kulunga Research Network; 2014.
Arensman E. Suicide prevention in an international context: progress and challenges. Crisis. 2017;38(1):1–6.
Hamilton AB, Brunner J, Cain C, Chuang E, Luger TM, Canelo I, et al. Engaging multilevel stakeholders in an implementation trial of evidence-based quality improvement in VA women’s health primary care. Transl Behav Med. 2017;7(3):478–85.
Tindana PO, Singh JA, Tracy CS, Upshur REG, Daar AS, Singer PA, et al. Grand challenges in global health: community engagement in research in developing countries. PLoS Med. 2007;4(9):e273.
Lavery JV, Tinadana PO, Scott TW, Harrington LC, Ramsey JM, Ytuarte-Nuñez C, et al. Towards a framework for community engagement in global health research. Trends Parasitol. 2010;26(6):279–83.
World Economic Forum. What young people can teach world leaders about mental health in 2020. 2020. https://www.weforum.org/agenda/2020/01/how-to-change-the-global-mental-health-crisis/. Accessed 15 Sept 2021.
Quigley A, Hutton J, Phillips G, Dreise D, Mason T, Garvey G, et al. Review article: implicit bias towards Aboriginal and Torres Strait Islander patients within Australian emergency departments. Emerg Med Australas. 2021;33(1):9–18.
LaMonica HM, Davenport TA, Braunstein K, Ottavio A, Piper S, Martin C, et al. Technology-enabled person-centered mental health services reform: strategy for implementation science. JMIR Ment Health. 2019;6(9):e14719.
de Weger EJ, Van Vooren N, Luijkx KG, Baan CA, Drewes HW. Achieving successful community engagement: a rapid realist review. BMC Health Serv Res. 2018;18(1):285.
Dunne TMD, Bishop LPD, Avery SMD, Darcy SM. A review of effective youth engagement strategies for mental health and substance use interventions. J Adolesc Health. 2016;60(5):487–512.
Highet NJ, Luscombe GM, Davenport TA, Burns JM, Hickie IB. Positive relationships between public awareness activity and recognition of the impacts of depression in Australia. Aust N Z J Psychiatry. 2006;40(1):55–8.
La Sala L, Teh Z, Lamblin M, Rajaram G, Rice S, Hill NTM, et al. Can a social media intervention improve online communication about suicide? A feasibility study examining the acceptability and potential impact of the #chatsafe campaign. PloS ONE. 2021;16(6):e0253278.
Wallace C, McCosker A, Farmer J, White C. Spanning communication boundaries to address health inequalities: the role of community connectors and social media. J Appl Commun Res. 2021. https://doi.org/10.1080/00909882.2021.1934513.
Quintana DS, Heathers JAJ. How podcasts can benefit scientific communities. Trends Cogn Sci. 2021;25(1):3–5.
Cathy N, Margaret F. In pursuit of effective charity advertising: Investigating the branding and messaging execution tactics used by charity marketers. Third Sector Rev. 2020;26(1):66–87.
Hatfield DP, Sliwa SA, Folta SC, Economos CD, Goldberg JP. The critical role of communications in a multilevel obesity-prevention intervention: lessons learned for alcohol educators. Patient Educ Couns. 2016;100:S3–10.
Simmons MB, Fava N, Faliszewski J, Browne V, Chinnery G, El K, et al. Inside the black box of youth participation and engagement: development and implementation of an organization-wide strategy for Orygen, a national youth mental health organization in Australia. Early Interv Psychiatry. 2021;15(4):1002–9.
Gabriel RM, Leichtling GJ, Bolan M, Becker LG. Using community surveys to inform the planning and implementation of environmental change strategies: participatory research in 12 Washington Communities. Am J Community Psychol. 2013;51(1):243–53.
King C, Gillard S. Bringing together coproduction and community participatory research approaches: using first person reflective narrative to explore coproduction and community involvement in mental health research. Health Expect. 2019;22(4):701–8.
Statistics ABo. 3303.0—causes of death, Australia, 2016. Australian bureau of statistics Canberra: Australia; 2017.
Gibson M, Stuart J, Leske S, Ward R, Tanton R. Suicide rates for young Aboriginal and Torres Strait Islander people: the influence of community level cultural connectedness. Med J Aust. 2021;214(11):514–8.
Case AD, Byrd R, Claggett E, DeVeaux S, Perkins R, Huang C, et al. Stakeholders’ perspectives on community-based participatory research to enhance mental health services. Am J Community Psychol. 2014;54(3):397–408.
Happell B, Ewart SB, Platania-Phung C, Stanton R. Participative mental health consumer research for improving physical health care: an integrative review. Int J Ment Health Nurs. 2016;25(5):399–408.
Happell B, Roper C. Consumer participation in mental health research: articulating a model to guide practice. Aust N Z J Psychiatry. 2007;15(3):237–41.
James AM. Principle of youth participation in mental health services. Med J Aust. 2007;187(7 Supplement):S57–60.
Schneider B. Reflection/commentary on a past article: “participatory action research, mental health service user research, and the hearing (our) voices projects.” Int J Qual Methods. 2018. https://doi.org/10.1177/1609406918788160.
Schneider B. Participatory action research, mental health service user research, and the hearing (our) voices projects. Int J Qual Methods. 2012;11(2):152–65.
National Mental Health Commission. Consumer and carer engagement: a practical guide. 2019.
NSW Mental Health Commission. Lived experience framework for NSW 2018 [17 June 2021]. https://www.nswmentalhealthcommission.com.au/sites/default/files/old/documents/final_lef_a4_layout_for_web.pdf. Accessed 8 Aug 2021.
Mental Health Coordinating council. Recovery orientated language guide. http://mhcc.org.au/wp-content/uploads/2019/08/Recovery-Oriented-Language-Guide_2019ed_v1_20190809-Web.pdf. Accessed 8 Aug 2021.
Meadows DH. Thinking in systems: a primer. London: Chealsea Green; 2008.
Malhi L, Karanfil Ö, Merth T, Acheson M, Palmer A, Finegood DT. Places to intervene to make complex food systems more healthy, green, fair, and affordable. J Hunger Environ Nutr. 2009;4(3–4):466–76.
Voinov A, Kolagani N, McCall MK, Glynn PD, Kragt ME, Ostermann FO, et al. Modelling with stakeholders—next generation. Environ Model Softw. 2016;77:196–220.
Jorm AF. Australia’s ‘Better Access’ scheme: has it had an impact on population mental health? Aust N Z J Psychiatry. 2018;52(11):1057–62.
Rosenberg SP, Hickie IB, McGorry PD, Salvador-Carulla L, Burns J, Christensen H, et al. Using accountability for mental health to drive reform. Med J Aust. 2015;203(8):328–30.
National Mental Health Commission. The national review of mental health programmes and services. Sydney: NMHC; 2014.
Green AE, Aarons GA. A comparison of policy and direct practice stakeholder perceptions of factors affecting evidence-based practice implementation using concept mapping. Implement Sci. 2011;6(1):104.
Grol RPTM, Wensing MJP. What drives change? Barriers to and incentives for achieving evidence-based practice. Med J Aust. 2004;180(6):S57-60.
Concannon TW, Meissner P, Grunbaum JA, McElwee N, Guise J-M, Santa J, et al. A new taxonomy for stakeholder engagement in patient-centered outcomes research. J Gen Intern Med. 2012;27(8):985–91.
Garces JP, Lopez GP, Wang Z, Elraiyah TA, Nabhan M, Campana JP, Boehmer K, Hasan R, Firwana B, Shippee N, Sloan JA, Eton DT, Erwin PJ, Montori VM, Murad MH. Eliciting patient perspective in patient-centered outcomes research: a meta narrative systematic review. Rochester: Patient-Centered Outcomes Research Institute; 2012.
Selby JV, Beal AC, Frank L. The patient-centered outcomes research institute (PCORI) national priorities for research and initial research Agenda. J Am Med Assoc. 2012;307(15):1583–4.
Gee G, Dudgeon P, Schultz C, Hart A, Kelly K. Aboriginal and Torres Strait Islander social and emotional wellbeing. In: Milroy H, Dudgeon P, Walker R, editors. Working together: Aboriginal and Torres Strait Islander mental health and wellbeing principles and practice. 2nd ed. Canberra: Commonwealth Government of Australia; 2014. p. 55–8.
National Health and Medical Research Council. Ethical conduct in research with Aboriginal and Torres Strait Islander Peoples and communities: guidelines for researchers and stakeholders. Canberra. 2018.
This research is being conducted under the Brain and Mind Centre’s Right care, first time, where you live Program, enabled by a $12.8 AUD million partnership with BHP Foundation. The Program will develop infrastructure to support decisions relating to advanced mental health, and guide investments and actions to foster the mental health and wellbeing of young people in their communities.
Ethics approval and consent to participate
This study has been approved by the Human Research Ethics Committee of the Sydney Local Health District (Protocol No. X21-0151 & 2021/ETH00553).
Consent for publication
YJS, PD, JR, GYL, SH, and GG declare they have no competing interests. JO is both Head of Systems Modelling, Simulation & Data Science at the University of Sydney's Brain and Mind Centre and Managing Director of Computer Simulation & Advanced Research Technologies (CSART). LF is currently employed part-time by the Brain and Mind Centre, University of Sydney; as Director of Knowledge Translation and Health Outcomes, Epidemiology Section, ACT Health & as Director of Policy Applications & Translational Science of CSART. IBH is the Co-Director, Health and Policy at the Brain and Mind Centre (BMC) University of Sydney. The BMC operates an early-intervention youth services at Camperdown under contract to headspace. He is the Chief Scientific Advisor to, and a 5% equity shareholder in, InnoWell Pty Ltd. InnoWell was formed by the University of Sydney (45% equity) and PwC (Australia; 45% equity) to deliver the $30 M Australian Government-funded Project Synergy (2017–20; a three-year Program for the transformation of mental health services) and to lead transformation of mental health services internationally through the use of innovative technologies. Sam Huntley is employed by the Brain and Mind Centre, University of Sydney and is a member of the Hunter New England Central Coast primary health Network’s Community Advisory Committee.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Freebairn, L., Song, Y.J.C., Occhipinti, JA. et al. Applying systems approaches to stakeholder and community engagement and knowledge mobilisation in youth mental health system modelling. Int J Ment Health Syst 16, 20 (2022). https://doi.org/10.1186/s13033-022-00530-1
- Stakeholder engagement
- Knowledge mobilization
- Participatory action research
- Youth mental health