Skip to main content

Building organizational readiness: initial field testing of an expert-informed typology of implementation strategies

Abstract

Background

Organizational readiness is a known barrier to implementing evidence-based practices (EBPs) in community mental health services. A robust methodology for enhancing organizational readiness for implementation (ORI) has the potential to improve implementation outcomes of EBPs and ensure better services for people with a psychiatric disability. Prior work established a framework of implementation strategies targeting ORI enhancement by asking a group of implementation experts from various fields to categorize strategies from the “Expert Recommendations for Implementing Change” (ERIC) Project into three readiness stages, consistent with the pre-action stages of the Transtheoretical Model of behavioral change: Pre-contemplation, Contemplation, and Preparation. The current study provides initial confirmation and refinement to this expert-driven typology based on community mental health field experiences.

Methods

We conducted in-depth interviews with stakeholders involved in a recent EBP implementation project. Participants included staff (n=9) from four community mental health agencies and the implementation team who facilitated the project (n=3). Their pre-implementation experiences were compared with the experts’ typology to identify consistencies and discrepancies.

Results

The participants’ experiences were congruent with two thirds of the strategies identified by the experts for specific ORI stages. The refinements included 12 strategies used in additional stages beyond the experts’ classification, four strategies from the ERIC list that were not included in the ORI typology, and five new strategies.

Conclusions

This study provides initial confirmation and refinements to the previously published ORI typology. The results offer guidance as to how ORI could be enhanced in the community mental health field.

Peer Review reports

Background

Numerous psychosocial interventions have been shown to be effective for supporting community participation in work, education, and independent living of people with a psychiatric disability. However, adoption of those interventions remains extremely low [1]. One of the most common reasons for the low adoption rates of evidence-based practices (EBPs) is limited organizational readiness for the desired practice change [2,3,4,5]. The concept of Organizational readiness is defined as “the degree to which the organization and those involved are individually and collectively primed, motivated, and capable of executing change” ( [6], p. 9). Higher readiness levels can lead to higher adoption rates of EBPs and more effective implementation processes [7, 8]. Therefore, addressing the three aspects of readiness: being primed, motivated, and prepared, across the organization—has the potential to engage more agencies in adopting EBPs successfully.

Over the last decade, research related to the effective implementation of EBPs has focused on specifying strategies to overcome barriers to successful implementation [9]. The most comprehensive compilation of such strategies was generated through the Expert Recommendations for Implementing Change (ERIC) project [10, 11], which includes 73 implementation strategies that were collected from the literature and then verified by a group of implementation experts from various health fields. Several attempts have been made to assess the relevance of these strategies to specific fields, including school-based mental health interventions [12], psychotherapy for PTSD [13], and cardiac prevention [14]. To date, such an assessment has not been conducted for psychosocial interventions in the mental health field.

In addition, although the ERIC compilation provides a comprehensive list of implementation strategies, it lacks internal organization or a framework to guide the selection of strategies at specific stages of implementation, such as pre-implementation, active implementation, sustainment, or scaling-up. The few published studies that have explored the utilization of the ERIC strategies before and during implementation described the timing of their utilization throughout the implementation process but did not provide information regarding their target outcomes [15, 16]. While these studies offer initial guidance regarding strategies that could be relevant prior to implementation, more information is needed on how these strategies may enhance specific organizational readiness benchmarks across the organization.

A recent study recruited a group of implementation experts from various fields and used a modified Delphi process to build consensus around classifying strategies from the ERIC compilation into a systematic framework that can support ORI development [17]. The experts identified strategies related to ORI enhancement from the ERIC compilation and categorized them into three readiness stages based on the Transtheoretical Model, a well-established model of behavioral change [18,19,20]. The three organizational readiness stages were Pre-contemplation, Contemplation, and Preparation.

The study resulted in a typology comprised of 48 pre-implementation strategies classified by ORI stages. While the expert-informed (EI) typology identified strategies that may support implementers progress through the stages of readiness development, it was constructed by experts from a variety of fields and was not specific to community mental health (CMH) services. Empirical data about the use of ORI strategies when implementing EBPs in the mental health field could help to further refine this typology.

The current study was aimed at confirming and refining the EI typology based on the field experiences of CMH stakeholders involved in a recent multi-site implementation of an EBP. A qualitative study design was used to evaluate the consistency between the experts’ classification of the ERIC strategies into the ORI stages, as constructed in the previous study, and the utilization of readiness-related strategies reported by the participants in the current study.

Methods

Study design

We conducted a qualitative exploratory study using in-depth interviews with various CMH stakeholders who had recently been involved in a multi-site implementation project. The interviews elicited participant experiences of becoming engaged in the implementation effort. We then compared the interviews data with the experts’ typology to detect consistencies and discrepancies between the two, in order to ascertain strategies’ confirmation in the field and to identify possible refinements relevant to each ORI stage in the CMH context.

The implementation project

The context for this study was a project that applied a large-scale implementation approach to a cognitive remediation intervention targeting improved employment outcomes in people with a psychiatric disability. The intervention, “Thinking Skills for Work,” complements vocational rehabilitation services, such as supported employment, and has been shown to be effective at improving cognitive and employment outcomes across multiple controlled trials [21,22,23,24,25]. The large-scale implementation approach was piloted (NIDILRR Grant # 90DP0096) across supported employment services in the State of Oregon and included both training and technical assistance over the period of 1 year. All implementation activities were conducted remotely, using technology (e.g., online self-paced training program) to support the roll out of Thinking Skills for Work across multiple agencies simultaneously. The State Director of Supported Employment who served as a project liaison, facilitated the agencies’ recruitment and provided input on training materials prior to launching the implementation activities. Also prior to launching the project, representatives from interested agencies participated in a video conference with the training team, to learn more about the project and clarify expectations so that they would be better able to identify interested and appropriate trainees from their staff.

Data collection

We conducted 12 retrospective, in-depth interviews, nine of them with staff from the four agencies involved in the pilot implementation project in various roles (see Table 1). Those interviews took 40–60 min. We also interviewed three members of the implementation team, including the intervention’s lead-developer, the training coordinator, and the State Director of Supported Employment. Those interviews took between 60 and 90 min, as they covered the interviewee’s interactions with all participating agencies and across multiple phases of the project. The interviews were conducted by the first author who worked as a research assistant with the implementation team.

Table 1 Study participants

Interviews focused on the participants’ experiences during recruitment and preparation for the implementation effort. Participants were asked about the time period from when they first learned about the project to the beginning of the training. We used three different interview guides, one for agency directors and supervisors who were involved in making the decision to join the project, one for staff members who were brought in after the decision to implement the intervention was made, and one for the implementation team members. All participants were asked about their role in the project, their overall experience, and how they were introduced to the project. The directors and supervisors were asked about personal and organizational challenges they encountered, what helped them overcome these challenges, and what influenced their decision to enroll their agency in the project. These interviewees were also asked how and to whom they introduced the project within their organization and how they responded if resistance was encountered. Supplement file number 1 presents the three interview guides.

The providers were asked about their views prior to implementation regarding personal and organizational barriers to taking on the new intervention, what was done to address those concerns, and by whom. The implementation team members were asked about the challenges they had experienced in getting buy-in from different stakeholders and overcoming those challenges. All participants were prompted to describe the strategies used to address attitudes, beliefs, and behaviors towards engaging in the implementation project. Finally, the participants were asked to suggest additional strategies that could have helped them or others to become even more primed, motivated, and prepared for the implementation process.

Procedures

The University Institutional Review Board declared the study to be non-human subject research. The implementation team was recruited by the first author, and the study participants from the agencies were recruited with the help of the state liaison. While informed consent was not required, all participants received information via email about the study goals, expectations, data security measures, and the voluntary nature of their participation. All interviews were conducted through the Zoom video-conferencing platform. The interviews were recorded and transcribed verbatim. The transcripts were de-identified for analysis purposes, using a code number to replace personal and agency identifiers. Participants received a gift card as a token of appreciation for their time and input.

Analysis

All 12 interviews were analyzed in three steps.

Step 1 – Coding interviews for ORI stages

The first author applied a content analysis approach [26] using the qualitative analysis software NVivo 12 to identify the pre-implementation ORI stages each participant went through (not including the implementation team). The coding was informed by behavioral and psychological markers related to each ORI stage consistent with the Transtheoretical Model (see Table 2).

Table 2 Behavioral markers of the ORI stages

Step 2 – Coding for ORI strategies

Two researchers analyzed the text corresponding to each ORI stage. The codebook used for this step consisted of the EI typology developed in our previous study [27] and all other ERIC implementation strategies that the experts considered not relevant to ORI development. The coders developed new codes for strategies mentioned in the interviews that were not included in the ERIC list. For each part of the text identified in Step 1, the coders followed a stepwise coding process (see Fig. 1) using the following questions: (A) Is the text consistent with a strategy assigned to the same ORI stage in the EI typology? (B) If not, is the text consistent with a strategy assigned to a different ORI stage in the EI typology? (C) If not, is the text consistent with a strategy from the ERIC list that was not included in the EI typology? (D) If not, is the text describing another strategy not included in the ERIC list? While a positive response to question A represents consistency with the experts’ classification, the remaining three categories reflect different types of refinements to the typology, based on findings from the field. Each researcher coded the data independently. The researchers met several times after completing the analysis of two to three interviews to develop consensus about their coding and the formulation of new coding categories before moving on to additional interviews.

Fig. 1
figure 1

Stepwise confirmation process for the coding of ORI strategies

Step 3 – Confirmation of the EI typology

We explored the consistency of implementation strategies reported by the participants with strategies in the corresponding stage of the EI typology. We summarized the findings from Step 2 of the analysis and organized the strategies reported by study participants into four groups: (A) strategies reported in relation to an ORI stage consistent with the same ORI stage as in the EI typology; (B) strategies consistent with a different ORI stage than in the EI typology; (C) strategies consistent with an ERIC implementation strategy not included in the EI typology; (D) new strategies, not included in the ERIC list; and (E) strategies from the EI typology that were not reported in this study. Summaries were developed for each ORI stage. Steps 2 and 3 were reviewed for validation by the second author, who is an implementation expert.

Results

The participants’ experiences spanned all three ORI stages. However, only providers described experiences relevant to the Pre-contemplation stage, while the initial experiences of most directors and supervisors were related to the Contemplation stage. One agency director was already familiar with the program; therefore, his initial stage was consistent with the Preparation stage. Overall, seven out of the nine field participants reached the Preparation stage, while two from the same agency remained in contemplation (see Fig. 2). In this agency, the supervisor expressed strong resistance to the change and did not develop any motivation to participate. For example, she said “I was there because I was required to.” In contrast, a supervisor from another agency who reached the Preparation stage expressed her motivation to participate in the project by saying, “Looking at the material it was pretty easy for me to figure out what they’re [the researchers] doing and why they’re doing this.” Such examples of motivation to change practice or lack thereof were evident across all field participants. Directors and supervisors reflected more on their ability to engage others in the process. For example, one of the directors described how he engaged the supervisor saying: “I talked about just the time commitment, you know, both for her and for the staff that she was choosing to get trained.” One of the supervisors described engaging other staff members in the project as follows: “We really wanted them to know and to be thinking about clients of theirs that we may be currently serving or have served who could benefit from it.” The level of directors’ involvement in engaging others differed across agencies depending on the dynamics between them and the supervisor and their level of involvement in integrating the project.

Fig. 2
figure 2

Study participants’ progress through the ORI stages

Strategies that were described most frequently by participants from all stakeholder groups were “Develop a formal implementation blueprint,” “Assess for readiness and identify barriers and facilitators,” “Identify early adopters,” and “Conduct educational meetings.” Strategies that were not described by any of the participants were mostly related to the Preparation stage of the EI typology such as “Alter patient/consumer fees,” “Change accreditation or membership requirements,” “Change record system,” and “Develop disincentives.”

Congruence by ORI stage

ORI-1, Pre-contemplation

All five implementation strategies (100%) classified as ORI-1 in the EI typology (Group A) were reported by study participants as being used in this stage. They also reported the use of three strategies that the experts assigned to later stages of the typology (Group B; e.g., “Identify and prepare champions”), and two strategies from the ERIC list that were not included in the typology (Group C, e.g., “Develop academic partnership”). Finally, they identified three new strategies (Group D, e.g., “Market the innovation”) not included in the EI or ERIC classifications. Overall, 13 strategies were reported by the participants as relevant for the Pre-contemplation stage. Supplement file 2 presents all study findings.

ORI-2, Contemplation

Sixteen of the 18 strategies (89%) included in this stage of the EI typology were reported by study participants (Group A). In addition, seven strategies were reported in this stage that were classified in the EI typology as ORI-3 only (Group B, e.g., “Tailor strategies”). Four strategies from the ERIC list not included in the EI typology were reported by the participants in this stage (Group C, e.g., “Provide ongoing consultation”). Finally, three new strategies described by the participants were identified as relevant to this stage (Group D, e.g., “Recruit a local coordinator”) which were also relevant to ORI-1. Overall, 30 implementation strategies were identified as relevant for the Contemplation stage.

ORI-3, Preparation

Twenty of the 38 strategies (53%) assigned to this stage by the experts were also reported by the study participants (Group A). Three strategies assigned by the experts to ORI-2 were reported in this stage (Group B, e.g., “Identify early adopters”). Another three strategies that were not part of the EI typology, but were included in the ERIC list, were reported as relevant to this stage (Group C, e.g., “Mandate change”). Four new strategies were identified as relevant for this stage (Group D, e.g., “Plan for time and space allocation”), with two of them unique to ORI-3 and two also relevant to ORI-1 and ORI-2. Overall, 31 strategies were reported as relevant for the Preparation stage.

Overall congruence

About two thirds of the EI typology were confirmed by the participants. Out of 48 strategies included in the EI typology, a total of 31 strategies (65%) were reported to be used by participants at the corresponding stage (Group A). The other 17 strategies (35%) were not reported by the participants in this study (Group E). Twelve strategies (25%) from the EI typology were reported in a stage additional to the stage(s) recommended by the experts (Group B). Four of the 25 strategies (16%) from the ERIC list that the experts did not include in the typology were reported by participants (Group C). Finally, five new strategies that were not part of the ERIC list or the EI typology were described by the study participants (Group D). Two of the five new strategies were specific only to the Preparation stage: “Plan for time and space allocation” and “Develop and test technical infrastructure.” The other three strategies were mentioned in relation to all three stages: “Involve high level management,” “Market the innovation,” and “Recruit a local coordinator.” Overall, 57 strategies were reported by study participants.

Discussion

This study is an important step towards establishing a systematic approach to building ORI across the organization. Confirming the EI typology of associations between implementation strategies and the readiness stages, they address with the actual experiences of individuals implementing an EBP at multiple agencies strengthens the combined structure of the Transtheoretical Model and the ERIC compilation. The study also revealed strategies that need to be further specified in terms of their actors, activities, and purpose and offered new strategies relevant to ORI development that were missing from the ERIC compilation. These findings facilitate the expansion of the EI typology with the addition of unique strategies that were not previously identified by implementation experts. Harnessing the stakeholders’ experiences to refine and expand on the experts’ views grounds the ORI typology in “real life” and reinforces its applicability to the CMH field.

Many of the strategies reported in this study were also deemed relevant to pre-implementation phases in other fields, such as “Identify barriers and facilitators for implementation” or “Identify and prepare champions” [15, 16]. However, this study took another step towards specifying the targeted utilization of those strategies within the pre-implementation phase by confirming their association with the behavioral and psychological markers of the ORI stages. As suggested by Presseau et al. [28] clarifying stakeholders’ behaviors is crucial for designing and measuring the outcomes of implementation interventions.

The EI typology and this study also address a knowledge gap identified specifically in mental health research about the temporality, theoretical justification, and outcomes missing in the reporting of implementation strategies [29]. By tying together strategies and pre-implementation stages based on a behavioral framework, we have added an operational layer to both the ERIC compilation and the Transtheoretical Model’s constructs. The findings further expand the results from a previous exploratory study [30], in which we identified strategies and associated actions reported by stakeholders in the CMH field and organized them within the readiness stages of the Transtheoretical Model. Extending this process to the ERIC strategies provides a broader range of behavioral applications to support ORI development. Further exploration is needed to better understand the unique role of different stakeholder groups in applying these strategies within the context of each stage and to list specific actions that can be used to implement each strategy.

While the quantitative findings are preliminary, the results from this study confirm a large portion of the EI typology and offer several additions to each ORI stage. The congruence level found in ORI-1 and ORI-2 was much higher than the congruence in ORI-3. It is possible that since ORI-3 had 38 strategies identified in the EI typology, compared to only five and 18 strategies in ORI-1 and 2, respectively, the study’s limited sample size was not large enough to capture all of them. The fact that strategies in ORI-1 and ORI-2 are more behavioral and general in nature than the strategies in ORI-3 which are more technical and specific might partly explain why not all strategies in ORI-3 were identified in this context. Larger empirical studies could provide more information about the strategies that were not reported in this project. Some strategies may still be relevant to the CMH field, although they were not applied in this specific implementation project, while some might not be relevant due to structural and administrative characteristics of the field.

In addition, several strategies assigned by the experts to ORI-3 relate to the same topic area and, therefore, could be collapsed into one (e.g., “Develop and organize quality monitoring systems” and “Develop and implement tools for quality monitoring”). If such consolidation had been applied to the EI typology, we might have seen higher consistency with the reports from the field. Further exploration of the strategies identified in the EI typology, but not reported in this study, could help distinguish which of them are still relevant for the field and should be included in a revised typology and which strategies could be consolidated.

The 12 strategies expanded to additional stages beyond their EI classification reflect the complexity of organizational readiness [7] that can be resolved with greater specification of their unique utilization in each stage. For example, the findings show that the experts considered several strategies to serve a practical purpose in ORI-3, but these strategies were also assigned to ORI-2 to support decision-making (e.g., “Make billing easier”). According to the participants, the early utilization of these strategies helped them evaluate the feasibility of the project and impacted their attitudes and beliefs regarding the change. Other strategies were applied across all stages but differed in the main actors in each stage. For example, “Recruit, designate, and train for leadership” was used by the implementation team in ORI-1 to recruit the state-level leadership, who used it to recruit executive-level leadership in ORI-2, leading to the recruitment of team-level leadership in ORI-3. The variations in target audience and purpose show how those strategies support the evolution of organizational readiness and how they gradually engage all levels of the project’s hierarchy to establish a collective sense of readiness [6, 7, 31, 32].

Lastly, some strategies reported by the participants were re-visited multiple times in response to recurring issues (e.g., “Tailor strategies”); the experts assigned these strategies to the implementation, rather than pre-implementation, phase. These strategies tend to be broadly defined and could be applicable throughout the implementation process. The ERIC strategies that were not included in the EI typology, but were reported by the study participants, seem to represent such general activities (e.g., “Conduct ongoing consultation”). These types of overarching strategies, used throughout the implementation process, were also reported by Bunger et al. [15], suggesting that some ERIC strategies are broader and not unique to a specific phase. While the strategies that span multiple stages contribute to the flexibility of the typology, they could also benefit from more specification as to the purpose, actors, and actions relevant to their utilization in each stage [29, 33]. Further confirmation is needed to ensure the relevance of these overarching strategies to ORI development beyond the current study.

The new strategies identified by participants broadened the typology and increased its flexibility. The additional strategies were either missing from the ERIC compilation, and therefore from the EI typology, or they underscored a latent aspect concealed in existing strategies that we thought should be highlighted in the context of ORI development. For example, two additions, “Develop and test technical infrastructure” and “Plan for time and space allocation,” align with revisions suggested by Perry et al. [14], based on a utilization evaluation of the ERIC compilation in multiple agencies providing cardiac prevention.

The overarching utilization of the strategy identified as “Develop and test technical infrastructure” is possibly unique to the implementation process piloted in this study, due to the remote nature of training and supervision conducted, as well as the fact that the EBP requires computer-based cognitive exercises. However, as experiences during the COVID-19 pandemic demonstrate, technology is likely to become more and more central to implementation efforts and should receive more attention in the planning phase, including the involvement of technical staff early in the process.

The other new strategies described by participants offer a variation to existing strategies. These include, “Involve high-level management,” “Market the innovation,” and “Assign a local coordinator.” While it could be argued that these three strategies are already covered under existing ones, we found it critical to specify them in relation to ORI development. For example, a local coordinator’s role in soliciting participation, supporting enrollment, providing feedback on educational materials, and solving problems goes beyond the role suggested in the original ERIC strategy: “Identify and prepare champions.” While the new strategies need to be confirmed in other CMH implementation projects, the fact that multiple stakeholders mentioned them at multiple sites supports their relevance to the field. In addition, most of the new strategies were described in relation to multiple stages, suggesting they need to be further specified to differentiate their application in each stage. Supplement 2 presents all the strategies addressed in this study including the new strategies and the stages they were assigned to.

The initial findings related to the differences across stakeholders and agencies indicate that capacity for ORI may vary by the person’s role in the agency and that individual factors may at times override relevant contextual factors. For example, in one agency the supervisor took the lead on integrating the project into the organization while in another agency the supervisor was extremely passive, and the director took the lead. Since supervisors may further influence their staff in either positive or negative way, our findings suggests that development of ORI among supervisors and higher-level managers may need particular attention and possibly additional strategies to address resistance to change among these levels. More importantly, the findings suggest that middle-level management plays a critical role in an organization reaching the Preparation stage, possibly even more than the high-level management.

The primary limitation of this study is the small number of organizations and participants included. Besides the initial small number of participating agencies in the project, not all project participants agreed to share their experiences and contribute to the study. This limitation might have impacted the variety of strategies we gathered, as well as biased responses. The information collected from multiple participants concerning each agency should have mitigated this gap to some extent. In addition, due to the small sample size, it is not possible to make any inferences about agency characteristics and participants’ usage of certain strategies. Future studies might offer more insights regarding the readiness level and choices of strategies in relation to specific organizational culture and context to provide more guidance on best use of the typology.

Another limitation is the specificity of the project. We restricted ourselves to one implementation project with one EBP to eliminate some of the “noise” that characterizes many implementation studies [34, 35]. The cost of this choice is the limited generalizability of our results even within the CMH field. Consequently, our findings should be interpreted with caution when evaluating their relevance in other implementation projects in the field. In addition, although we conducted the interviews within a year from the beginning of the implementation effort, the retrospective interviews could have jeopardized the accuracy of the participants’ reports. Future studies should collect data in real time during pre-implementation.

The results from this initial field testing of the experts’ typology respond to the knowledge gap concerning ORI enhancement. The high level of congruence between the EI typology and the experiences reported in the field confirms the structure of the stage-based model of ORI development. This study implies that the EI typology needs to be further tested in the field on a larger scale to continue its establishment. The high level of consistency found in ORI-1 and ORI-2 and the additional strategies offered for these two stages add critical knowledge about how positive attitudes and beliefs may be established in the early stages of an implementation project. Further inquiries are particularly necessary to address inconsistencies between the experts’ typology and the findings from the field and clarify their relevance to ORI stages. It is also important to have a better conceptual understanding about the overlap of some strategies across stages. While it is possible that certain strategies will have multiple uses, there is a need to further specify their unique utilization in each stage. Additional validation of the behavioral benchmarks achieved by the strategies in each stage will also increase the applicability of the typology as a guiding tool to help advance members of an organization through the ORI stages. Finally, using evidence collected from the target population to support implementation knowledge is a relatively new approach [36,37,38]. More research involving stakeholders from the field is needed to establish the final ORI typology.

Conclusion

This initial field testing provided valuable confirmation of a previously developed EI typology of strategies for ORI development and informed further refinements from the perspective of multiple CMH sites and stakeholders. In addition to the high congruence between the experts and the experiences described by study participants, the study findings also expanded the potential utilization of several strategies to other stages and offered new strategies relevant to ORI development that were not known previously identified by the ERIC project. This confirmation and enrichment of the EI typology align with the original purpose of creating a “bank of strategies” to be utilized according to local context and needs. More operationalization (i.e., actors, dose, specific actions, etc.) is needed to better guide the application of the strategies beyond the readiness stages they address. The strategies that were not reported in this study and the strategies that were added to the typology should be confirmed in other CMH implementation efforts to ensure their relevance beyond this specific project. The ORI typology has demonstrated that it holds promise for a practical and dynamic methodology that can position agencies for effective adoption of EBPs that support people with a psychiatric disability.

Availability of data and materials

The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.

Abbreviations

CMH:

Community mental health

EBP:

Evidence-based practices

EI:

Expert-informed

ERIC:

Expert recommendations for implementing change

NIDILRR:

National Institute on Disability, Independent Living, and Rehabilitative Research

ORI:

Organizational Readiness for Implementation

References

  1. Interdepartmental Serious Mental Illness Coordinating Committee. The way forward: federal action for a system that works for all people living with SMI and SED and their families and caregivers. Washington DC: SAMHSA; 2017. Available from: https://store.samhsa.gov/product/The-Way-Forward-Federal-Action-for-a-System-That-Works-for-All-People-Living-With-SMI-and-SED-and-Their-Families-and-Caregivers-Full-Report/PEP17-ISMICC-RTC

  2. Powell BJ, Proctor EK, Glass JE. A systematic review of strategies for implementing empirically supported mental health interventions. Res Soc Work Pract. 2014;24(2):192–212.

    Article  Google Scholar 

  3. Simpson DD, Flynn PM. Moving innovations into treatment: a stage-based approach to program change. J Subst Abuse Treat. 2007;33:111–20 [cited 2017 Nov 13]. Available from: https://ac-els-cdn-com.ezproxy.bu.edu/S0740547207000232/1-s2.0-S0740547207000232-main.pdf?_tid=a5fb32de-c891-11e7-a08d-00000aacb361&acdnat=1510591534_7305111c837c96f392f1f75cf42c1991.

    Article  Google Scholar 

  4. Stirman SW, Gutner CA, Langdon K, Graham JR. Bridging the gap between research and practice in mental health service settings: an overview of developments in implementation theory and research. Behav Ther. 2016;47(6):920–36 Available from: www.sciencedirect.com.

    Article  Google Scholar 

  5. Weiner BJ, Clary AS, Klaman SL, Turner K, Alishahi-Tabriz A. Organizational readiness for change: what we know, what we think we know, and what we need to know. In: Albers B, Shlonsky A, Mildon RAB, Shlonsky A, Mildon R, editors. Implementation Science 30. Cham: Springer; 2020. p. 101–44.

  6. Holt DT, Vardaman JM. Toward a comprehensive understanding of readiness for change: the case for an expanded conceptualization. J Chang Manag. 2013;13(1):9–18.

    Article  Google Scholar 

  7. Weiner BJ. A theory of organizational readiness for change. Implement Sci. 2009;4(67):1–9 [cited 2017 Apr 29]. Available from: http://www.implementationscience.com/content/4/1/67.

    Google Scholar 

  8. Weiner BJ, Mettert KD, Dorsey CN, Nolen EA, Stanick C, Powell BJ, et al. Measuring readiness for implementation: a systematic review of measures’ psychometric and pragmatic properties. Implement Res Pract. 2020;1:263348952093389.

    Article  Google Scholar 

  9. Kirchner JE, Waltz TJ, Powell BJ, Smith JL, Proctor EK. Implementation strategies. In: Brownson RC, Colditz GA, Proctor EK, editors. Dissemination and Implementation Research in Health: Translating Science to Practice, Second Edition. 2nd ed: Oxford University Press; 2017. p. 1–37. https://doi.org/10.1093/oso/9780190683214.001.0001.

  10. Powell BJ, Warren G, Mcmillen JC, Proctor EK, Carpenter CR, Griffey RT, et al. A compilation of strategies for implementing clinical innovations in health and mental health. Med Care Res Rev. 2012;69(2):123–57 [cited 2019 Mar 11]. Available from: http://mcr.sagepub.com.

    Article  Google Scholar 

  11. Powell BJ, Waltz TJ, Chinman MJ, Damschroder LJ, Smith JL, Matthieu MM, et al. A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project. Implement Sci. 2015;10(21):1–14 Available from: http://www.biomedcentral.com/content/pdf/s13012-015-0209-1.pdf%255Cn. http://www.implementationscience.com/content/10/1/21.

    Google Scholar 

  12. Cook CR, Lyon AR, Locke J, Waltz TJ, Powell BJ. Adapting a compilation of implementation strategies to advance school-based implementation research and practice. Prev Sci. 2019;20:914–35.

    Article  Google Scholar 

  13. Sayer NA, Bernardy NC, Yoder M, Hamblen JL, Rosen CS, Ackland PE, et al. Evaluation of an implementation intervention to increase reach of evidence-based psychotherapies for PTSD in US Veterans Health Administration PTSD Clinics. Adm Policy Ment Heal Ment Heal Serv Res. 2020; Available from:. https://doi.org/10.1007/s10488-020-01086-3.

  14. Perry CK, Damschroder LJ, Hemler JR, Woodson TT, Ono SS, Cohen DJ. Specifying and comparing implementation strategies across seven large implementation interventions: a practical application of theory. Implement Sci. 2019;14(1):1–13.

    Article  Google Scholar 

  15. Bunger AC, Powell BJ, Robertson HA, MacDowell H, Birken SA, Shea C. Tracking implementation strategies: a description of a practical approach and early findings. Heal Res Policy Syst. 2017;15(1):1–12.

    Article  Google Scholar 

  16. Rundall T, Paone D, Humphries DL, Huynh AK, Hamilton AB, Farmer MM, et al. A pragmatic approach to guide implementation evaluation research: strategy mapping for complex interventions. Front Public Heal. 2018;6:1–15 Available from: www.frontiersin.org.

    Article  Google Scholar 

  17. Vax S, Farkas M, Russinova Z, Mueser KT. Enhancing organizational readiness for implementation: constructing a typology of readiness-development strategies using a modified Delphi process. Implement Sci. 2021;16(61):1–11.

    Google Scholar 

  18. Levesque DA, Prochaska JM, Prochaska JO, Dewart S, Hamby LS, Weeks WB. Organizational stages and processes of change for continuous quality improvement in health care. Consult Psychol J Pract Res. 2001;53(3):139–53 [cited 2018 Oct 28]. Available from: http://web.a.ebscohost.com.ezproxy.bu.edu/ehost/pdfviewer/pdfviewer?vid=1&sid=d2c89656-52f3-438c-ab82-ed3201cc24c4%2540sessionmgr4007.

    Article  Google Scholar 

  19. Prochaska JM, Prochaska JO, Levesque DA. A transtheoretical approach to changing organizations. Adm Policy Ment Health. 2001;28(4):247–61 [cited 2018 Oct 27]. Available from: https://link-springer-com.ezproxy.bu.edu/content/pdf/10.1023%252FA%253A1011155212811.pdf.

    Article  CAS  Google Scholar 

  20. Prochaska JO, DiClemente CC. Stages and processes of self-change of smoking: toward an integrative model of change. J Consult Clin Psychol. 1983;51(3):390–5 [cited 2018 Oct 28]. Available from: http://content.apa.org/journals/ccp/51/3/390.

    Article  CAS  Google Scholar 

  21. McGurk SR, Mueser KT, Pascaris A. Cognitive training and supported employment for persons with severe mental illness: one year results from a randomized controlled trial. Schizophr Bull. 2005;31:898–909.

    Article  Google Scholar 

  22. McGurk SR, Mueser KT, Feldman K, Wolfe R, Pascaris A. Cognitive training for supported employment: 2-3 year outcomes of a randomized controlled trial. Am J Psychiatry. 2007;164:437–41.

    Article  Google Scholar 

  23. McGurk SR, Mueser KT. Sustaining the long-term effects of supported employment for persons with psychiatric disabilities. Am J Psychiatry. 2016;173:953–5.

    Article  Google Scholar 

  24. McGurk SR, Mueser KT, Xie HY, Welsh J, Kaiser S, Drake RE, et al. Cognitive enhancement treatment for people with mental illness who do not respond to supported employment: a randomized controlled trial. Am J Psychiatry. 2015;172(9):852–61.

    Article  Google Scholar 

  25. McGurk SR, Mueser KT. In: McGurk SR, Mueser KT, editors. Cognitive remediation for successful employment and psychiatric recovery: the thinking skills for work program. New York: Guilford Press; 2021. p. 372.

    Google Scholar 

  26. Hsieh HF, Shannon SE. Three approaches to qualitative content analysis. Qual Res. 2005;15(9):1277–88.

    Google Scholar 

  27. Vax S, Farkas M, Russinova Z, Drainoni M-L, Mueser KT. Constructing a typology of strategies for enhancing organizational readiness for implementation. In: The 13th Annual Conference on the Science of Dissemination and Implementation in Health; 2020. p. Interactive poster.

    Google Scholar 

  28. Presseau J, Mccleary N, Lorencatto F, Patey AM, Grimshaw JM, Francis JJ. Action, actor, context, target, time (AACTT): a framework for specifying behaviour. Implement Sci. 2019;14(102):1–13.

    Google Scholar 

  29. Hooley C, Amano T, Markovitz L, Yaeger L, Proctor E. Assessing implementation strategy reporting in the mental health literature: a narrative review. Adm Policy Ment Heal Ment Heal Serv Res. 2020;47(1):19–35 Available from: https://doi.org/10.1007/s10488-019-00965-8.

    Article  Google Scholar 

  30. Vax S, Gidugu V, Farkas M, Drainoni M-L. Ready to Roll: Strategies and actions to enhance organizational readiness for implementation in community mental health. Implement Res Pract. 2021;2:1–11.

    Google Scholar 

  31. Benzer JK, Charns MP, Hamdan S, Afable M. The role of organizational structure in readiness for change: a conceptual integration. Health Serv Manage Res. 2017;30(1):34–46 [cited 2018 Oct 20]. Available from: http://journals.sagepub.com.ezproxy.bu.edu/doi/pdf/10.1177/0951484816682396.

    Article  Google Scholar 

  32. Proctor EK, Landsverk J, Aarons G, Chambers D, Glisson C, Mittman B. Implementation research in mental health services: an emerging science with conceptual, methodological, and training challenges. Adm Policy Mental Health Mental Health Serv Res. 2009;36:24–34.

    Article  Google Scholar 

  33. Proctor EK, Powell BJ, McMillen JC. Implementation strategies: recommendations for specifying and reporting. Implement Sci. 2013;8(1):139–50 Available from: http://implementationscience.biomedcentral.com/articles/10.1186/1748-5908-8-139.

    Article  Google Scholar 

  34. Hohmann AA, Shear MK. Community-based intervention research: coping with the “noise” of real life in study design. Am J Psychiatry. 2002;159(2):201–7 Available from: http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?cmd=Retrieve&db=PubMed&dopt=Citation&list_uids=11823259.

    Article  Google Scholar 

  35. Vinson CA, Stamatakis KA, Kerner JF. Dissemination and implementation research in community and public health settings. In: Brownson RC, Colditz GA, Proctor EK, editors. Dissemination and Implementation Research in Health: Translating Science to Practice, Second Edition. 2nd ed: Oxford University Press; 2017. p. 1–30. https://doi.org/10.1093/oso/9780190683214.001.0001.

  36. Moreno EM, Moriana JA, Kitson A, Marshall A, Bassett K, Zeitz K, et al. User involvement in the implementation of clinical guidelines for common mental health disorders: a review and compilation of strategies and resources. Health Research Policy Syst. 2016;14:61 Available from: http://health-policy-systems.biomedcentral.com/articles/10.1186/s12961-016-0135-y.

    Article  Google Scholar 

  37. Pintello D. Commentary: establishing scientific rigor and excellence in implementation science training to improve the deployment of evidence-based mental health services. Adm Policy Ment Heal Ment Heal Serv Res. 2020;47(2):265–71 Available from: https://doi.org/10.1007/s10488-020-01014-5.

    Article  Google Scholar 

  38. Stewart RE, Beidas RS, Last BS, Hoskins K, Byeon YV, Williams NJ, et al. Applying NUDGE to inform design of EBP implementation strategies in community mental health settings. Adm Policy Ment Heal Ment Heal Serv Res. 2020; Available from: https://doi.org/10.1007/s10488-020-01052-z.

Download references

Acknowledgements

This study was conducted as part of the Rehabilitation Sciences Ph.D. program and the Center for Psychiatric Rehabilitation at Boston University, Sargent College. We would like to thank the valuable input of the Supported Employment programs in Oregon, the Implementation team (Susan McGurk, Chitra Khare, and Jeff Krolick), the second coder Melody Riefer and graphic designer Amanda Kimball. We would also like to thank the directors of the Boston University Center for Psychiatric Rehabilitation – E. Sally Rogers, Dori Hutchinson, and Larry Kohn for supporting this study.

Reporting guidelines followed

We used the SRQR 21-ITEM Reporting checklist for qualitative research: O’Brien, B. C. et al. (2014). Standards for reporting qualitative research: a synthesis of recommendations, Academic Medicine, 89(9), pp. 1245-1251. Doi: https://doi.org/10.1097/ACM.000000000000388.

Funding

This study was partially funded by the Boston University Center for Psychiatric Rehabilitation and the National Institute on Disability, Independent Living and Rehabilitation Research (NIDILRR), Disability Rehabilitation Research Program (DRRP) grant #90DP0096 (Principal Investigator Marianne Farkas). NIDILRR is an agency within the Administration for Community Living (ACL); Department of Health and Human Services (HHS). The content of this publication does not necessarily represent the policy of NIDILRR, ACL, or HHS nor endorsement by the Federal Government.

Author information

Authors and Affiliations

Authors

Contributions

This study was designed and conducted as part of SV’s Ph.D. dissertation work, with guidance and support from MF (Dissertation Chair), KM (Dissertation Committee Co-Chair), MLD, and ZR (Dissertation Committee Members). SV conducted all the procedures, including participants’ recruitment, data collection, and analysis. SV also drafted and revised the manuscript. The Dissertation Committee consulted on design issues; MF and ZR consulted on the identification of potential participants, data collection, and the analysis. All authors reviewed, edited, and approved the final manuscript.

Corresponding author

Correspondence to Sigal Vax.

Ethics declarations

Ethics approval and consent to participate

The study was granted exemption by the Boston University Institutional Review Board. The participants confirmed their participation by email in response to an invitation to participate that included the study description.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1:

InterviewGuides.PDF – The three different interview guides used for this study.

Additional file 2:

Results.PDF – A comprehensive PDF file presenting the results from the analysis of congruence.

Additional file 3:

Reporting Checklist.PDF – A reporting checklist intended for qualitative manuscripts.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Vax, S., Farkas, M., Mueser, K.T. et al. Building organizational readiness: initial field testing of an expert-informed typology of implementation strategies. Implement Sci Commun 3, 22 (2022). https://doi.org/10.1186/s43058-022-00257-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s43058-022-00257-7

Keywords