- Study protocol
- Open Access
Contextual influences on the impact of a peer worker-led self-stigma program for people with mental health issues: protocol for an interventional implementation science study
Implementation Science Communications volume 1, Article number: 26 (2020)
Despite significant recent reforms, Australia’s mental health system faces substantial service and workforce shortages, and progress on the reorientation of services to a recovery focus is also slow. Implementing recovery-focused programs led by mental health peer workers is one way of addressing these issues, but uptake of these programs in Australia is patchy and not well evaluated.
This project will investigate the implementation of a peer-led mental health self-stigma program across three diverse settings in an Australian capital city. The project aims to (1) examine the processes and contextual influences on successful implementation of peer work roles and (2) evaluate the impact a peer worker-led program has on individuals and services.
The project will use an interventional implementation science approach: small-scale, researcher-led implementation of the Honest, Open, Proud program to explore contextual influences, and implementation, service and individual outcomes. The Consolidated Framework for Implementation Research (CFIR) will be used to guide investigation of contextual factors. Implementation outcomes (feasibility, fidelity, acceptability, sustainability) and service outcomes (safety, person-centeredness and effectiveness) will be examined in interviews with a range of staff within the services, checklists of adherence to program protocols and analysis of administrative data. Individual quantitative outcomes will include self-stigma, recovery and quality of life, measured at baseline, end of program and follow-up. Qualitative enquiry will focus on experiences with the peer worker and program.
Quantitative analyses will comprise change scores on service and individual outcome measures. Where possible, differences between settings and the effects of potential confounds will be tested using multi-level linear models, which will account for clustering of individuals within programs and settings. Qualitative data will be analysed using a framework approach, which is an effective way of combining inductive and deductive coding to test and refine a thematic frame.
Recovery-focused, peer-led programs have the potential to provide a unique contribution to the management of mental health issues. Currently, there is little information to guide successful implementation of these roles. This project will provide important preliminary data on the factors that affect implementation and the impact peer workers can have.
ANZCTR - Trial Registration ID: ACTRN12619001312134. Registered 26/09/2019
The Australian mental health system is undergoing a significant period of reform and change. Government reforms are shifting service delivery from a one-size-fits-all approach to a stepped-care model, and the recent roll-out of the National Disability Insurance Scheme (NDIS) has changed the funding and availability of many support programs. Increasing the capacity of mental health peer workers has been identified as a key strategy to support the mental health workforce and to improve continuity of care in this time of change [1,2,3,4], making the development and promotion of the mental health peer workforce a priority for the Australian Government. In 2014, the National Mental Health Commission National Review of Mental Health Programmes and Services recommended establishing National Mental Health Peer Workforce Development Guidelines to define the roles and functions of peer workers and provide guiding principles for their training, employment and support . However, it is important that policymakers and service planners include rigorous evaluation in their implementation of these programs to develop our understanding of how peer work produces beneficial outcomes.
Peer work is a rapidly growing area that can have a positive impact on both consumer outcomes and satisfaction with care, as well as for the peer workers themselves [5,6,7]. International evidence shows that peer work is able to produce meaningful change for mental health consumers [5, 7], but implementation of peer work programs is piecemeal, and the link between programs with research evidence and current practice is poor . To ensure the optimal delivery of peer work in the broader Australian mental health system, it is vital to trial the implementation of international evidence-based peer recovery programs.
Peer work is a rapidly growing industry internationally [5, 6, 9, 10]. Peer support occurs informally in support groups or partnerships, but it has also developed formally into voluntary and paid positions within consumer-operated and standard healthcare services: peer work . Peer workers can perform a variety of conventional roles within services, including coaching, advocacy, case management, outreach, crisis support and delivering assertive community treatment and social support programs . They use their lived experience of mental illness to inform their practices in providing emotional, social and instrumental support to other consumers [7, 12], although a recent systematic review found equivocal evidence for the benefits of peers over other types of workers in these positions .
However, peer workers can also be employed in unique, peer-specific roles, in which they use their own lived experience to promote recovery through mutuality, reciprocity and role-modelling . In these circumstances, recent reviews conclude that peer support workers can produce a range of benefits for consumers, including an increased sense of independence and empowerment, improved self-esteem and confidence, improved social support and community integration, breaking down perceived stigma and fostering a sense of hope through positive role-modelling [5, 7]. Peer workers have also reported experiencing personal benefits from their occupation, including improved self-esteem and a sense of empowerment [6, 7].
One way in which peer work has progressed in recent years has been through the development of manual-based peer-led programs that specifically target peer worker outcomes such as stigma, empowerment and recovery. Honest, Open, Proud is one such program, developed by renowned mental health consumer and principal investigator on the National Consortium for Stigma and Empowerment, Professor Patrick Corrigan. Originally called Coming Out Proud due to its strong basis in the gay and lesbian movement, the program focuses on identity and disclosure as a means for reducing internalised stigma and promoting empowerment . Consisting of three “lessons” and a booster session, Honest, Open, Proud peer facilitators guide participants through a workbook and activities that explore whether they identify as someone with a mental illness (or other similar terms), the pros and cons of disclosure and how to construct their story in a way that is safe for everyone if they do choose to disclose, particularly if they choose to be completely open such as through public speaking [13, 14].
Early randomised controlled trial evidence from diverse populations, including adolescents  and adults with schizophrenia  indicates that Honest, Open, Proud is effective at reducing disclosure-related stress and self-stigma, and improving recovery attitudes, but effects on other outcomes such as empowerment are less clear [15,16,17]. As the program becomes popular internationally, including Australia, it is important to add to the evidence of its effectiveness and explore how it performs for different groups and in different settings. In addition, the role of the program as a catalyst for authentic peer work is also important to establish.
Thus, the current study has two primary aims:
Examine the processes and contextual influences on successful implementation of peer work roles; and
Evaluate the impact the peer worker-led recovery program, Honest, Open, Proud has on individuals and on services.
This study protocol addresses the Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) checklist  and the Standards for Reporting Implementation Studies (StaRI) checklist . Additional file 1 presents the SPIRIT Checklist, and Additional file 2 presents the StaRI checklist.
The project will use an interventional implementation science approach: small-scale, researcher-led implementation of the Honest, Open, Proud program to explore outcomes and contextual influences . Consistent with Proctor et al.’s conceptual model for implementation research , the project will explore intervention strategies, implementation strategies and outcomes for implementation, services and individuals.
Better Together is being conducted according to the principles of community-based participatory research, which are particularly appropriate in implementation research that focuses on the relevance and uptake of interventions. The investigators all identify as mental health consumers and work in peer-identified roles and the research questions were developed by consumers and carers . The intervention was developed and tested by a mental health consumer researcher, and local training for facilitators will be provided by an experienced social worker and peer supervisor, who was involved in program development and is the program’s Australian champion.
Research protocols and materials were co-developed with stakeholders via the ACACIA Consumer and Carer Advisory Group to ensure the nature and style of questions is appropriate for participants. In particular, consistent with consumer and carer preferences , qualitative feedback opportunities will be semi-structured to balance specific questions with the opportunity for participants to relate their experiences in their own words.
A pilot study focused on testing methods and measures for the individual level outcomes and preliminary investigation of selected implementation outcomes will be conducted with university students prior to commencement of the main study.
Data collection is planned for three distinct settings within one Australian capital city: community-based public mental health services, a university and a recovery-focused adult mental health learning organisation (Recovery College).
Peer workers have recently been introduced into the city’s public mental health system, with positions in a variety of hospital and community-based settings. Group-based programs are already undertaken by at least one peer worker and opportunities exist to extend implementation to other peer workers. The program will be delivered and evaluated during usual peer work sessions.
The second planned setting is a university. The investigator team, who are all peer researchers and educators, will facilitate the Honest, Open, Proud program for staff and students of the university as part of the wellbeing program. The program will be held on campus at times agreed with participants to accommodate study and work responsibilities.
The third planned setting is a mental health Recovery College. The investigators and/or peer educators within the Recovery College will facilitate the program as part of 2019 second semester course offerings. The Recovery College has a specific focus on co-production and the importance of peer-led recovery, making it an ideal comparator for the other settings, in which these concepts are being introduced retrospectively.
Honest, Open, Proud consists of nine tasks in three lessons, plus a follow-up booster session (see Table 1) . The delivery format is flexible, but is usually delivered in three weekly 2-h sessions, with the 2-h booster approximately 3–4 weeks later. The pilot will be delivered in this format, and participants queried about other delivery formats such as an intensive 1-day workshop or 1-hour weekly sessions delivered across a semester in the post-program feedback. Final choice of delivery format will be guided by participant preference when groups are formed.
The full program manual and workbook are available at www.comingoutproudprogram.org.
Each session comprises information about stigma and disclosure, worksheets and activities that encourage participants to think about their own views and choices, to weigh up pros and cons and to make informed choices. The group format allows for discussion of key points and practice sessions for disclosure and story-telling in a supportive environment, facilitated by peers with experience being “out”.
Study participants comprise three main groups at each setting: peer workers, other staff and people with experience of mental illness.
It is anticipated that approximately eight peer workers will participate, including the three study investigators. All peer workers will be invited to contribute data to the study in the form of reflective notes on their experiences and/or participation in an interview.
Up to five staff members in each setting involved in the peer worker program directly or indirectly will be invited to participate by direct invitation from one of the investigators. During implementation of the program, investigators will develop a list of leadership, clinical and administrative staff at each location who may be able to provide insight into the key implementation issues. Participants will be purposively sampled from these lists to provide a range of views on the five implementation construct domains of the Consolidated Framework for Implementation Research (CFIR) .
The third key group is people with lived experience of mental illness. As an exploratory study, no specific sample size calculations have been undertaken for individual outcomes. Based on medium-sized effects observed in previous studies trialling the Honest, Open, Proud program , we will aim for a minimum of three groups comprising eight participants per study setting (n = 72). Data collected during pilot testing of the intervention will also be included (total N = 80).
There are no specific exclusion criteria. However, the program and associated research project measures are all in English and approach the issues from a Western conceptualization of stigma and mental illness. As such, this may prove challenging for people from different cultural or language backgrounds. We will not specifically exclude these people from participating, but they may require extra assistance to take part.
Outcomes and measures
The primary outcome is the success of the implementation of peer work roles across the settings. This will be investigated using the CFIR , which provides a “menu of constructs” associated with successful implementation and allows systematic assessment of barriers and facilitators and the generation of theory. The CFIR consists of five core domains:
Characteristics of individuals
Using the tools provided at www.cfirguide.org, including the interview guide builder, specific constructs of focus to investigate contextual influences for the current study across the five domains will be selected in collaboration with the ACACIA Consumer and Carer Advisory Group. Expected constructs include adaptability and complexity of the intervention, external policy and incentives, inner setting culture and implementation climate, individual stage of change and all process constructs.
Measures of specific implementation outcomes (feasibility and acceptability) to be completed after program delivery are provided in Additional file 3. The evaluation questions are designed to gather information from program participants on the Honest, Open, Proud program, the delivery format (number and length of sessions), and the peer facilitators. Fidelity will be measured using the program’s fidelity scale (available at http://www.comingoutproudprogram.org/images/Honest_Open_Proud_Fidelity_2.9.2017-min.pdf), scored by one investigator at each session.
Integral to the participatory nature of both the program and the project is information about the peer delivery. The project investigators will record notes and reflections on their own experiences delivering the program as part of data collection. Other peer workers involved in program delivery will be invited to do the same and to participate in an interview at the completion of each Honest, Open, Proud program to generate rich, cumulative data on the implementation process.
At the service level, outcomes of interest are safety, person-centeredness and effectiveness. These will be investigated via interviews with staff and analysis of administrative data, including quality and safety monitoring, and routine outcome measurement statistics such as service level consumer experience data [e.g. the Your Experience of Service (YES) questionnaire ] to assess overall changes to these figures following introduction of the peer workers and program.
Table 2 presents the secondary outcomes at the individual level. These outcomes will be self-stigma, measured by both a specific self-stigma scale [Internalized Stigma of Mental Illness Inventory ] and a disclosure scale [Coming Out with Mental Illness Scale ], empowerment [Empowerment Scale ], recovery [Self-Identified Stages of Recovery ], and quality of life [Personal Wellbeing Index ]. A brief distress screener [Distress Questionnaire 5 ] and personal and clinical characteristics are also included.
Figure 1 presents the study flow.
Table 3 presents the assessments and their delivery time points in the study.
Baseline measures including demographic and limited clinical data will be completed upon recruitment to the study and return of the consent form, prior to commencing the Honest, Open, Proud program. Questionnaires will be available both on tablets managed by the research team (using Qualtrics) and in paper form, according to participant preference. To avoid error introduced by participant management of codes, questionnaires will be identified by participant first name (or pseudonym) and last initial. Participants will be advised about the use of names during the initial contact about the program so that they may elect not to participate if uncomfortable with identified data collection. Names will be removed and replaced by a code after matching of questionnaires is complete. Outcome measures will be completed at the conclusion of Lesson 3 (3 weeks) and again at the conclusion of the booster session (6–8 weeks after baseline).
A brief feedback session (half-to-one hour) will be conducted at the end of the booster sessions to gather additional information on participant experience. People who did not participate in the outcome measurement may elect to participate in the feedback session by completing written informed consent at this point of the study. Participants may take part in a face-to-face discussion or elect to answer the same open-ended questions in a brief, online survey.
Total participation time, including program sessions, outcome measures and the feedback session is approximately 10–12 h across 8 weeks. Data collection is anticipated to commence in October 2019 and be completed early in 2020.
Data for peer workers facilitating the program will comprise reflective notes on experiences of delivering the program and 30-min interviews conducted at the conclusion of each Honest, Open, Proud course (after the booster session). Peer workers will be asked to keep written or typed notes on their experiences to be submitted for inclusion in the research data at the conclusion of data collection. Interviews will follow a semi-structured protocol, guided by the CFIR constructs, and will be digitally recorded for professional transcription. Willingness to continue participation will be checked with peer workers at each participation occasion. Participation may extend for 6 months from October 2019 and comprise three to four interviews in that period. Facilitation of the program will take approximately 8 h plus preparation time. Estimated research data collection time is approximately 2 h of notes per course (total of 6 h) plus up to 2 h of interview time (30 min per interview).
Data for staff in the settings in which the program will be delivered will comprise one interview of approximately 60 min. Interviews with up to five staff members at each site will follow a semi-structured protocol, guided by the CFIR constructs, and will be digitally recorded for professional transcription. Participation for staff members will be on a single occasion only. Data collection from staff is anticipated to commence late in 2019, after at least one Honest, Open, Proud course has been completed at the site.
During study setup, a request for aggregated administrative data on quality, safety and consumer experiences will be made to the data governance bodies of each location. To minimise issues of confidentiality and delays due to complex permissions, these data may be restricted to publicly available reports on performance. The purpose of examining administrative data is to supplement primary data from staff observations of service-level changes and individual participant outcomes.
Quantitative data will comprise program scores of fidelity, overall service scores on measures of safety, effectiveness, patient-centeredness and experience, and individual measures of self-stigma, empowerment, recovery and quality of life. Due to the exploratory nature of the study, it is expected that quantitative data will be primarily descriptive and comprise change scores across time. Where possible, differences between settings and the effects of potential confounds will be tested using multi-level linear models, which will account for clustering of individuals within programs and settings.
All qualitative data will be analysed using a framework approach . Framework analysis, a comprehensive and systematic qualitative analysis method driven by the observations of participants, is particularly appropriate for studies with applied research questions that are concerned with people’s experiences of a phenomenon and the influence of contextual factors. Data will be interrogated for the CFIR constructs  (contextual factors) and implementation, service and individual outcomes specified in the conceptual model . The framework will be elaborated with inductive coding of concepts not well-described by the high level dimensions of the model.
The current protocol describes a study that uses an implementation science approach to evaluate a small-scale implementation of a program in three distinct settings in an Australian context. The primary aim of the study is to evaluate the success of the implementation of the program, with secondary aims to examine other related implementation factors including feasibility, fidelity, acceptability and sustainability of the program, service-level outcomes of safety, person-centeredness and effectiveness of the program, and individual-level outcomes for the effectiveness of the program on aspects such as self-stigma, recovery and quality of life. Peer work can have a positive impact on both consumer outcomes and satisfaction with care, as well as for the peer workers themselves [5,6,7]. Further, augmenting the workforce with this important and accessible group has strong potential to alleviate substantial burden on the mental health system [3, 4] and improve services’ recovery focus [5,6,7]. This project will provide critical implementation evidence to ensure the optimal delivery of peer work in the broader Australian mental health system to achieve these benefits.
Availability of data and materials
The ACT Consumer and Carer Mental Health Research Unit
Australian Capital Territory
Australian New Zealand Clinical Trials Registry
Consolidated Framework for Implementation Research
National Disability Insurance Scheme
Your Experience of Service
Banfield MA, Morse AR, Gulliver A, Griffiths KM. Mental health research priorities in Australia: a consumer and carer agenda. Health Res Policy Syst. 2018;16(1):119.
Commonwealth of Australia Fourth National Mental Health Plan - An agenda for collaborative government action in mental health 2009-2014. Canberra: Commonwealth of Australia; 2009.
Lawn S, Smith A, Hunter K. Mental health peer support for hospital avoidance and early discharge: an Australian example of consumer driven and operated service. J Ment Health. 2008;17(5):498–508.
National Mental Health Commission, editor. Contributing lives, thriving communities - report of the National Review of Mental Health Programmes and Services. In: Commission NMH, editor. Sydney: National Mental Health Commission; 2014.
Davidson L, Bellamy C, Guy K, Miller R. Peer support among persons with severe mental illnesses: a review of evidence and experience. World Psychiatry. 2012;11(2):123–8.
Rebeiro Gruhl KL, LaCarte S, Calixte S. Authentic peer support work: challenges and opportunities for an evolving occupation. J Ment Health. 2016;25(1):78–86.
Repper J, Carter T. A review of the literature on peer support in mental health services. J Ment Health. 2011;20(4):392–411.
Lloyd-Evans B, Mayo-Wilson E, Harrison B, Istead H, Brown E, Pilling S, et al. A systematic review and meta-analysis of randomised controlled trials of peer support for people with severe mental illness. BMC Psychiatry. 2014;14(1):39.
Franke CCD, Paton BC, Gassner L-AJ. Implementing mental health peer support: a South Australian experience. Aust J Prim Health. 2010;16(2):179–86.
Gray M, Davies K, Butcher L. Finding the right connections: peer support within a community-based mental health service. Int J Soc Welfare. 2016;26:188–96.
Pitt V, Lowe D, Hill S, Prictor M, Hetrick SE, Ryan R, et al. Consumer-providers of care for adult clients of statutory mental health services. Cochrane Database Syst Rev. 2013;28(3):CD004807.
Solomon P. Peer support/peer provided services: underlying processes, benefits, and critical ingredients. Psychiatr Rehab J. 2004;27(4):392–401.
Corrigan PW, Kosyluk KA, Rusch N. Reducing self-stigma by coming out proud. Am J Public Health. 2013;103(5):794–800.
Buchholz BA, Corrigan PW. "Coming Out" might be worth it! http://comingoutproudprogram.org/index.php/about-and-research. Accessed 16 Oct 2019.
Mulfinger N, Muller S, Boge I, Sakar V, Corrigan PW, Evans-Lacko S, et al. Honest, Open, Proud for adolescents with mental illness: pilot randomized controlled trial. J Child Psychol Psychiatry Allied Discip. 2018;59(6):684–91.
Setti VPC, Loch AA, Modelli A, de Almeida Rocca CC, Hungerbuehler I, van de Bilt MT, et al. Disclosing the diagnosis of schizophrenia: a pilot study of the ‘Coming Out Proud’ intervention. Int J Soc Psychiatry. 2019;65(3):244–51.
Rüsch N, Abbruzzese E, Hagedorn E, Hartenhauer D, Kaufmann I, Curschellas J, et al. Efficacy of Coming Out Proud to reduce stigma’s impact among people with mental illness: pilot randomised controlled trial. Br J Psychiatry. 2014;204(5):391–7.
Chan AW, Tetzlaff JM, Altman DG, Laupacis A, Gotzsche PC, Krleza-Jeric K, et al. SPIRIT 2013 statement: defining standard protocol items for clinical trials. Ann Intern Med. 2013;158(3):200–7.
Pinnock H, Barwick M, Carpenter CR, Eldridge S, Grandes G, Griffiths CJ, et al. Standards for Reporting Implementation Studies (StaRI) Statement. BMJ. 2017;356:i6795.
Mittman B. Implementation science in health care. In: Brownson RC, Colditz GA, Proctor EK, editors. Dissemination and implementation research in health. New York: Oxford University Press; 2012. p. 400–18.
Proctor EK, Landsverk J, Aarons G, Chambers D, Glisson C, Mittman B. Implementation Research in Mental Health Services: an Emerging Science with Conceptual, Methodological, and Training challenges. Adm Policy Ment Health. 2009;36(1). https://doi.org/10.1007/s10488-008-0197-4.
Banfield M, Randall R, O'Brien M, Hope S, Gulliver A, Forbes O, et al. Lived experience researchers partnering with consumers and carers to improve mental health research: reflections from an Australian initiative. Int J Ment Health Nurs. 2018;27(4):1219–29.
Corrigan PW, Nieweglowski K, Buchholz BA, Al-Khouja MA. Honest, Open, Proud: To eliminate the stigma of mental illness. Manual. 2017.
Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implementation Sci. 2009;4:50.
Australian Government Department of Health. Your Experience of Service: Australia’s National Mental Health Consumer Experience of Care Survey. Canberra: Committee AHMACMHISS; 2015.
Boyd JE, Otilingam PG, Deforge BR. Brief version of the Internalized Stigma of Mental Illness (ISMI) scale: psychometric properties and relationship to depression, self esteem, recovery orientation, empowerment, and perceived devaluation and discrimination. Psychiatr Rehabil J. 2014;37(1):17–23.
Corrigan PW, Morris S, Larson J, Rafacz J, Wassel A, Michaels P, et al. Self-stigma and coming out about one’s mental illness. J Commun Psychol. 2010;38(3):259–75.
Rogers ES, Chamberlin J, Ellison ML, Crean T. A consumer-constructed scale to measure empowerment among users of mental health services. Psychiatric serv. 1997;48(8):1042–7.
Andresen R, Caputi P, Oades LG. Do clinical outcome measures assess consumer-defined recovery? Psychiatry Res. 2010;177(3):309–17.
Cummins RA, Eckersley R, Pallant J, van Vugt J, Misajon RJSIR. Developing a national index of subjective wellbeing: the Australian Unity Wellbeing Index. Soc Indic Res. 2003;64(2):159–90.
Batterham PJ, Sunderland M, Carragher N, Calear AL, Mackinnon AJ, Slade T. The Distress Questionnaire-5: population screener for psychological distress was more accurate than the K6/K10. J Clin Epidemiol. 2016;71:35–42.
Ritchie J, Spencer L. Qualitative data analysis for applied policy research. In: Bryman A, Burgess B, editors. Analyzing qualitative data. London: Routledge; 1994. p. 174–93.
The authors gratefully acknowledge the assistance of the ACACIA Consumer and Carer Advisory Group and the participants in the ACACIA priority-setting studies for their guidance on the research questions and design. Keith Mahar, Connie Galati, Dianna Smith, Tessa Cleradin and Andrew Staniforth also assisted with implementation design.
MB and this project are supported by Fellowship MRF1150698. AG and ARM are supported by funding provided by ACT Health for ACACIA: The ACT Consumer and Carer Mental Health Research Unit. The funding bodies will play no role in study design, data collection and analysis, or reporting of results.
Ethics approval and consent to participate
All participants will provide consent to participate in this study, either written or via the tablet pre-intervention questionnaire. Consent will be collected by the research team. The ethical aspects of this research have been approved by the ACT Health Human Research Ethics Committee (2019/ETH/00105) and The Australian National University Science and Medical Delegated Ethics Review Committee (ANU HREC 2019/411). Important protocol modifications will be approved by the ACT Health Human Research Ethics Committee and communicated to The Australian National University Science and Medical Delegated Ethics Review Committee prior to implementation.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Banfield, M., Morse, A.R. & Gulliver, A. Contextual influences on the impact of a peer worker-led self-stigma program for people with mental health issues: protocol for an interventional implementation science study. Implement Sci Commun 1, 26 (2020). https://doi.org/10.1186/s43058-020-00002-y
- Mental health
- Peer work
- Honest Open Proud
- Consolidated Framework for Implementation Research