Development of a qualitative data analysis codebook informed by the i-PARIHS framework
Implementation Science Communications volume 3, Article number: 98 (2022)
The Integrated-Promoting Action on Research Implementation in Health Services (i-PARIHS) framework and its predecessor, PARIHS, have been widely utilized in implementation studies. Although i-PARIHS developers have focused on creating tools to guide facilitators in its application in practice, tools are also needed for evaluation and research. Codebooks with clear and meaningful code labels and definitions are an important component of qualitative data analysis and have been developed for other widely used frameworks. There is no such codebook for i-PARIHS. Additionally, sub-constructs for the Innovation, Recipients, and Context constructs lack definitions, and there is no sub-classification of facilitation activities for the Facilitation construct. The lack of a standardized codebook hinders our ability to synthesize research findings across studies, explore and test the range of activities that are utilized in facilitation efforts, and potentially validate and further refine i-PARIHS. This paper describes a rigorous process of developing a detailed qualitative codebook informed by the i-PARIHS framework.
A workgroup of qualitative researchers conducted a rigorous four-phase process to develop a codebook informed by i-PARIHS. In phase 1, workgroup members reviewed and discussed literature, consulted an organizational scientist, and drafted and refined subcodes and definitions for i-PARIHS constructs. In phase 2, they obtained feedback from an expert panel and further refined subcodes and definitions. In phase 3, they obtained feedback from i-PARIHS developers/experts and incorporated it into the codebook. Finally, two studies piloted the application of the codebook which informed the final version.
The resulting i-PARIHS-informed codebook includes definitions for the four main constructs of the framework: Innovation, Recipients, Context, and Facilitation; subcodes and definitions for characteristics of each of these constructs; and instructions for the suggested application of individual codes and use of the codebook generally.
The standardized codes and definitions in the codebook can facilitate data exploration, pattern identification, and insight development informed by the i-PARIHS framework. Qualitative analysts can also use them to explore interactions between i-PARIHS constructs, maximize the potential for comparing findings across studies, and support the refinement of the i-PARIHS framework using empirical findings from multiple studies.
Scholars posit that conceptual approaches, i.e., theories, models, and/or frameworks (TMFs), should inform the implementation and evaluation of evidence-based practices and programs [1,2,3,4]. The Integrated-Promoting Action on Research Implementation in Health Services (i-PARIHS) framework is one of the more commonly used implementation frameworks [5, 6]. Its predecessor, the PARIHS framework, was specifically designed for implementing complex multi-disciplinary team-based innovations in healthcare settings and was one of the first frameworks to account for the complex nature of the implementation process [7, 8]. It had a rich history of refinement [9,10,11,12,13] ultimately leading to the development of the i-PARIHS framework . Both PARIHS and i-PARIHS have been widely utilized to guide the assessment of factors that influence implementation, inform data collection and analysis, and evaluate study findings [5, 14, 15]. More recently, i-PARIHS has been increasingly utilized to prospectively plan what facilitators will do to support implementation , to inform what they are doing during the implementation process [17, 18], and to develop resources to train and support facilitators .
Two of the main strengths of the i-PARIHS framework are (1) its emphasis on the interaction between implementation influences and (2) the assertion that facilitation is the active ingredient for successfully implementing an innovation. The framework proposes SI = Fac (I + R + C), i.e., successful implementation (SI) is the result of the facilitation (Fac) of the Innovation (I) with the Recipients (R) in their context (C) [7, 19]. Characteristics of three of these constructs, the Innovation (the practice or program being implemented), the Recipients (the individuals and teams that influence and are affected by innovation implementation), and the Context (the setting within which implementation occurs), were identified by framework developers based on the theoretical and empirical literature, as well as their own experiences, and are typically considered to be implementation determinants . Recognizing the complexity of implementation processes, i-PARIHS developers propose that the characteristics of these three constructs interact . Facilitation, the fourth construct and a unique feature of i-PARIHS, is the active ingredient in implementation efforts, interacting with the characteristics of the other three constructs to maximize the potential for implementation success. Facilitation has been defined as a “multi-faceted interactive process of problem solving, enabling and supporting individuals, groups, and organizations in their efforts to adopt and incorporate innovations into routine practices” . It is both a role (i.e., the facilitator) and a process (i.e., the activities that support and enable implementation) [7, 19]. Although the role of facilitator can be filled by individuals who are internal to systems implementing change, it can also be filled by experts who are external to such systems.
Despite the importance and value of applying TMFs, i.e., i-PARIHS, they are not always utilized or well-described in implementation studies [5, 22]. To foster their use, scholars have created tools to operationalize them [23, 24]. Developers of i-PARIHS have focused on creating tools for its application in practice by providing guidance to facilitators for fostering successful implementation [7, 17]. To facilitate the use of other TMFs in evaluation and research, scholars have developed measures for assessing constructs [25, 26], including qualitative interview guides and codebooks. Codebooks are an important component of the qualitative data analysis process; they facilitate data exploration, pattern identification, and insight development . The use of a deductive codebook based on a TMF or a hybrid inductive-deductive codebook that includes the former as well as additional inductive codes can help focus the analysis of qualitative data, as well as test and refine the TMF. Standard operational definitions of constructs and sub-constructs have been developed for several TMFs, including the publicly available codebook created for the Consolidated Framework for Implementation Research (CFIR) [28, 29], a coding manual developed for the Normalization Process Theory , and a list of operationalized definitions for the Exploration, Preparation, Implementation, Sustainment (EPIS) framework [31, 32]. However, there is no such codebook or list of operational definitions for the i-PARIHS framework. Thus, individual studies develop their own codebooks, making it difficult to compare findings across studies using i-PARIHS.
There are a number of challenges to creating a qualitative codebook informed by i-PARIHS. Codebooks typically include code labels (usually a word or short phrase), definitions of labels, instructions for using them, and examples of representative data, The i-PARIHS framework was originally presented within the context of a guide for facilitation practitioners in which developers described, based on their own experiences, what facilitators should do to address characteristics of the innovation, recipients, and context . Although i-PARIHS developers specify characteristics of the Innovation, Recipients, and Context constructs, these lack the formal definitions [5, 14] needed for a codebook. Additionally, the Facilitation construct is under-defined and there is no sub-classification of facilitation activities . Consistent with its presentation within the context of a facilitation guide, i-PARIHS does include recommendations for facilitators, but many of the recommended actions are narrowly focused on one of the specific constructs and/or are very complex. No studies to date have used these recommendations as subcodes. The lack of clearly defined construct characteristics and sub-classification of facilitation activities hinders efforts to compare findings across studies, explore and test the range of activities that are utilized in facilitation efforts, and potentially validate or further refine i-PARIHS. This paper describes a rigorous four-phase process of developing a detailed qualitative codebook informed by i-PARIHS, including a sub-classification of facilitation activities, identified in previous work [33, 34], which can be used to explore how the characteristics of i-PARIHS constructs influence implementation and how they interact with each other in the process.
Established in 1998, the US Department of Veterans Affairs (VA) Quality Enhancement Research Initiative (QUERI)  currently funds more than 40 programs and centers across the US that leverage innovative scientific methods to accelerate evidence into practice and improve the quality and safety of care delivered to veterans. One of the first funded programs, now called Behavioral Health (BH) QUERI, was focused on improving behavioral health care. In 2016, BH QUERI began multiple implementation efforts utilizing the i-PARIHS framework to guide their implementation facilitation strategies, as well as data collection and analysis pertaining to factors determining implementation success. This work represented a unique opportunity to use common measures and methods to examine the effectiveness of facilitation across interventions, sites, and varying levels of facilitation. In 2017, i-PARIHS developers Gill Harvey and Alison Kitson invited BH QUERI to form a collaboration for purposes of knowledge sharing and advancing the study of facilitation. An early decision of this collaboration was that a common or standard codebook informed by the i-PARIHS framework would be helpful as a first step toward more robust comparisons of results across disparate projects using the framework. The BH QUERI team took responsibility for this work. Below we describe the process of codebook development.
All authors were members of a workgroup that planned and conducted a rigorous four-phase process to develop the codebook. MJR, KD, SL, and JS have expertise in implementation science (including implementation facilitation and the i-PARIHS framework) and qualitative methods. BS is a research assistant who had previous experience in using the original PARIHS framework in qualitative data analysis. Accepting the four i-PARIHS constructs as top-level codes, in phase 1, we identified preliminary subcodes for each of the constructs and developed subcode definitions and instructions for their use. In phase 2, we conducted an iterative expert panel process to obtain feedback from other implementation scientists who had expertise in qualitative methodology and i-PARIHS. In phase 3, we sought feedback from i-PARIHS developers/experts, and in phase 4, we piloted the application of the codebook in two studies (see Fig. 1 for a summary of the tasks within each phase). Below, we describe these phases in detail.
Phase 1: Preliminary codebook development (September 2017 to November 2018)
Innovation, Recipients, and Context subcodes
For the Innovation, Recipients, and Context constructs, workgroup members assessed the names of i-PARIHS construct characteristics  for use as subcode labels. We adopted names we considered to be conceptually meaningful and clear and modified names or made recommendations for labels to maximize clarity. We assessed, based on literature and our experience, whether there were important characteristics of i-PARIHS constructs that were missing from source materials but should potentially be included as subcodes. Because there was significant overlap between the characteristics of the Recipient and Context constructs, we sought consultation from an organizational science and qualitative methodology expert to help us identify context subcodes and differentiate between Context and Recipient subcodes.
One or two workgroup members were responsible for drafting the initial definition and coding instructions for each subcode based on descriptions of the construct characteristic in core materials [7, 19, 36], literature related to theories that informed i-PARIHS developers’ understanding of the characteristic (e.g., Complexity Theory ;), and other literature related to i-PARIHS or its predecessor, PARIHS (e.g., [37,38,39]). When they were still unable to create a clear definition, they reviewed other relevant literature (e.g., ) (see Additional file 1 for a list of literature reviewed in the development process). All other workgroup members individually reviewed the drafted material and provided feedback. The member responsible incorporated feedback and, if needed, reviewed additional literature and modified the definition and/or instructions. The workgroup members then reviewed and discussed the second iteration and suggested additional edits, if appropriate. The workgroup leader, MJR, incorporated these suggestions, as well as the consultant’s suggestions for context subcode definitions and coding instructions, and finalized the preliminary definition and instructions.
Facilitation Activity subcodes
Because i-PARIHS developers assert that facilitators activate implementation by assessing and responding to the Innovation, Recipients, and Context , we chose to focus subcodes for the Facilitation construct on activities that facilitators perform. Since the i-PARIHS Facilitation construct is under-defined and lacks sub-classification , we opted to use facilitation activities we had identified and described in previous work as the foundation for subcodes. In a large VA-funded project that applied and evaluated an implementation facilitation strategy, researchers had performed a targeted literature review, including empirical and conceptual literature about the PARIHS framework. They then conducted a directed content analysis of 85 qualitative interviews with three facilitators over a two- and one-half-year period to create a list of facilitation activities . Building on this work, in preparation for another study, BH QUERI researchers conducted a comprehensive scoping review of facilitation literature from 1996 to 2015 and further refined this list, resulting in 32 facilitation activities with operational descriptions . The workgroup reviewed and adopted this list of activities as the subcodes for the construct and further refined the previously developed descriptions of facilitation activities. Because of the large number of specific facilitation activity subcodes, we also clustered these subcodes to create higher-level codes to enable a more expedited analysis with the option to pursue more detailed sub-coding within specific clusters.
Phase 2: Expert panel review (September 2018 to February 2019)
We recruited eight researchers who had expertise in implementation science (average of 7.8 years) and qualitative methodology (average of 12.6 years) to serve on an expert panel. Panel members rated their knowledge of the i-PARIHS framework on a scale from 1 to 5 (poor to excellent) and reported a median rating of 4 (very good). We conducted the expert panel review process in three cycles. In cycle 1, the panel reviewed and provided feedback on subcodes for the Innovation construct. In cycle 2, they reviewed and provided feedback on Facilitation Activity subcodes, and in cycle 3, on the Context and Recipients subcodes. Each cycle was completed in two rounds.
In round 1 of each cycle, we provided the panel with a document containing (a) information about the development process; (b) codebook material including construct subcodes, definitions, and coding instructions; (c) workgroup recommendations for combining, modifying, and excluding subcodes; and (d) questions for additional feedback. The document also provided instructions for the review process, asking panel members to (1) evaluate codebook material for clarity and comprehensiveness; (2) evaluate workgroup recommendations for changes and/or additions to i-PARIHS construct characteristics; and (3) provide written feedback, including recommendations for edits to codebook material. MJR reviewed round 1 feedback and contacted panel members individually, as needed, to clarify their recommendations. MJR and KLD then determined what material could be revised and finalized based upon round 1 results vs. material that would require further panel discussion in round 2; they updated the codebook accordingly.
In round 2 of each cycle, we provided the panel with a document containing (a) codebook material that we had been unable to finalize; (b) panel members’ recommendations from round 1; (c) if appropriate, additional material from the literature; and (d) instructions for this round of the review process. Panel members individually reviewed this material and then met together by phone to discuss and provide verbal feedback to MJR. MJR and KLD reviewed and came to a consensus on feedback that merited further discussion and incorporated this feedback to finalize the preliminary codebook.
Phase 3: i-PARIHS developers review (February to July 2019)
To further refine the codebook, we obtained feedback from i-PARIHS framework developers, Drs. Gill Harvey and Alison Kitson and Dr. Sarah Hunter, a post-doctoral research fellow who was leading a team to develop tools and resources to support the use of the framework in research and clinical practice. We provided these experts with a draft of the codebook and workgroup lead MJR met with them by phone to orient them to the codebook, describe the workgroup’s development process, and ask them to review and provide feedback on the codebook as a whole and the subcodes, definitions, and coding instructions. The experts individually reviewed the codebook and then met face-to-face to discuss and synthesize their comments and recommendations into a single document, which they provided to the workgroup. MJR and KLD reviewed their comments and came to a consensus on changes to the codebook.
Phase 4: Codebook piloting (July 2019 to April 2021)
To ensure that code labels, definitions, and instructions were clear, we piloted the application of the codebook in data collected for two BH QUERI projects, both informed by the i-PARIHS framework. In one project, facilitators had supported the implementation of measurement-based care (MBC) in VA primary care clinics . In the other project, facilitators had supported the implementation of the collaborative care model in VA-based outpatient mental health teams, called Behavioral Health Interdisciplinary Program (BHIP) teams . The results of these studies and a complete description of their methods will be presented in future publications.
MBC project researchers piloted the codebook on qualitative data collected for multiple study components. In total, the pilot included the application of all Innovation and Recipients codes and clustered Context and Facilitation Activity subcodes to transcripts for 28 individual and 11 group interviews, as well as 122 site-level debriefing note documents. The analysis team top-coded all documents using the qualitative data analysis software program, Atlas.ti 8. They then sub-coded data for each construct either by reviewing and summarizing the top-level data in a Word document organized by subcodes, or by sub-coding in Atlas.ti; extracting the coded text; and then summarizing data for each subcode. Finally, they compiled the subcode summaries in an Excel document to create a matrix across data sources for each subcode, enabling them to explore similarities and differences across sites as well as interactions between facilitation activities and site characteristics. The analysis team included MJR, KLD, and BNS.
BHIP project researchers piloted the codebook during a secondary analysis of data collected from 31 BHIP providers at nine VA medical centers to understand providers’ perceptions of and experiences with the implementation of the collaborative care model. The goal of the secondary analysis was to examine the implementation barriers and facilitators through the lens of the i-PARIHS framework. They applied codes to interview transcripts for the Innovation, Recipients, and Context constructs, excluding subcodes that were not relevant for their specific collaborative care model implementation effort. For the Context construct, they used the same set of clustered context subcodes applied in the MBC project. Their data sources did not include information about facilitation activities, so the Facilitation activity codes were not used. They applied the top-level construct codes to interview transcripts using NVIVO 12 software and created quote reports for each construct. They then summarized coded text by relevant subcodes for the four i-PARIHS constructs in a Word document. Because they had previously coded the same dataset by collaborative care model elements , they also examined the cross-coding between the collaborative care model and i-PARIHS codes/subcodes. The analysis team included JLS, KLD, and another BH QUERI investigator who had served on the expert panel.
After the codebook piloting process was complete for both projects, the analysis teams met to discuss what they had learned that might inform the final version of the codebook. In advance of this meeting, they were asked to review the codes and definitions and consider how they had applied them, whether there were codes they struggled with understanding or applying, whether they edited code definitions, and whether additional instructions were needed for using the codes. They were also asked to provide feedback about the usability of the codebook, advantages and disadvantages to using it, and how we might improve it. We then edited codebook instructions based on their feedback.
After the preliminary development of the codebook (phase 1), each phase of the development process informed revisions to the results of the previous phase. We thus describe below the results of all four phases for each of the i-PARIHS constructs and for the codebook more generally.
Because the characteristics of the Innovation construct were well described and/or grounded in theory in the core materials, subcode labels were based on characteristics identified by i-PARIHS developers with one exception. Based on literature and our experience, in phase 1, we identified complexity as an important innovation characteristic and added a Complexity subcode to the codebook. In phases 2 and 3, the expert panel and i-PARIHS developers concurred. Definitions of the Innovation subcodes were modified throughout all phases of development (see Table 1 for the names of the characteristics of the Innovation construct, the subcode labels/definitions, and modifications made during the development process).
There were several challenges to identifying subcodes for the Recipients construct. Although the Innovation and Context constructs were part of the original PARIHS framework, the Recipients construct was new in i-PARIHS and not as well defined conceptually as the others had been. Also, the Recipients construct includes both individuals and teams, making it harder to differentiate some Recipient characteristics from characteristics of the Context. We thus made a number of modifications to subcode labels initially named after the characteristics of recipients identified by developers. First, although i-PARIHS identified motivation, values and beliefs, and goals as distinct Recipient characteristics, we felt it would be hard to parse these out in qualitative material. We therefore opted to combine these characteristics into one subcode, Personal attributes; individuals and teams collecting data specifically about the motivation, values and beliefs, and/or goals of study participants can add these for their project-specific codebook. Second, based on i-PARIHS developers’ feedback, we modified the labels for two Context characteristics (time, resources, and support and existing networks) to focus on how the presence or absence of these characteristics affects recipients. Third, at the recommendation of the expert panel, we added the word autonomy to the Power and authority subcode label to differentiate the ability to influence the actions of others from recipients’ own actions. Fourth, we did not include local opinion leaders as a subcode because this characteristic delineates a change agent role that may not be applicable for a specific implementation effort, and other types of change agents (e.g., champions, QI team) may be involved. In the codebook, we suggest that subcodes be added for local change agents if capturing change agent roles is important for a study. Finally, during the piloting process, we added a subcode for General attitude to account for statements study participants made about what they thought or felt about the innovation generally, e.g., they liked it or enjoyed using it. Definitions of the Recipients subcodes were modified across the phases of development (see Table 2 for the names of the characteristics of the Recipients construct, the subcode labels/definitions, and modifications made during the development process).
There were also a number of challenges to identifying subcodes for the Context construct. First, i-PARIHS developers identified characteristics of context as unique to particular levels (e.g., policy drivers and priorities are considered characteristics of the outer context). However, in our collective experience, most characteristics of context can/might occur across organizational levels (e.g., local policies and priorities in the inner context might also impact implementation). To address this challenge, we developed two sets of context subcodes, one for characteristics of context and the other for levels of the implementation context (e.g., local, organizational; see Additional file 2 for the full codebook). To develop the context characteristics subcodes, we combined those delineated by the developers if they were similar in content but broken out into different organizational levels. For example, we combined i-PARIHS’s formal and informal leadership support (a characteristic of the inner/local context) and leadership and senior management support (a characteristic of the inner/organizational context) into a single Leadership support subcode (see Table 3 for names of the characteristics of the i-PARIHS Context construct, the subcode labels/definitions, and modifications made during the development process). In the codebook, we recommend that characteristics of context be co-coded with the level(s) at which they occur. For example, to code discussion of the influence of a broad organizational policy affecting multiple units in a large healthcare organization, coders would apply both the Policies and priorities code for the characteristic of the context and the Inner/Organizational code to identify the level of context.
Second, the organizational scientist we consulted felt strongly that there were characteristics of context missing in the framework. To address this concern, we modified some subcodes and added several others. We modified the initial Culture subcode by adding the word “climate,” the initial Evaluation and feedback subcode by adding the word “monitoring,” and the initial Incentives subcode by adding the word “rewards.” For conceptual clarity, we added the word “mandates” to the initial Policies and priorities subcode. We also added two new subcodes: Infrastructure, resources, and support and Political factors and dynamics. As with the other constructs, we modified definitions of the context subcodes across the phases of development.
Finally, several characteristics of Context identified by i-PARIHS, the mechanisms for embedding change and environmental stability are higher-level concepts that can best be identified during the analysis process. For example, i-PARIHS developers suggest that the mechanisms for change may include a variety of activities that fall under other context characteristics, such as regular team meetings and performance review systems (examples of Structures and systems) or audit and feedback processes (included in Evaluation, monitoring, and feedback). By co-coding characteristics of context subcodes with generic enablers of implementation subcode, data analysts can identify the mechanisms for embedding change during the analysis process. Similarly, environmental stability is related to multiple contextual events/circumstances, e.g., changes or lack of changes in structures and systems, leadership, or policies and procedures. We felt that ultimately determining environmental stability calls for judgment based on a full understanding of the context at multiple levels. In the codebook, we suggest that these two characteristics of context be explored during later stages of data analysis.
We based the initial Facilitation Activity subcodes on 32 activities previously identified and defined [33, 34], and we clustered these into 10 higher-order facilitation activity subcodes. Based on expert panel recommendations, we standardized subcode labels (e.g., Providing clinical education rather than Clinical education), made significant changes to many of the individual subcode definitions, and made minor changes to the clustered subcode definitions (see Table 4 for the clustered subcodes and final definitions; see Additional file 2 for the 32 individual subcodes and definitions).
Instructions and explanatory material
In addition to i-PARIHS construct codes, subcodes for the characteristics of constructs, and definitions, the codebook (see Additional file 2) includes instructions for the application of individual codes and for the use of the codebook more generally. We initially developed instructions for applying some of the individual codes during phase 1 and then modified them based on feedback from the expert panel, i-PARIHS experts, and the piloting process. Instructions expand on subcode definitions by providing inclusion and/or exclusion criteria, as well as guidance for differentiating between subcodes and/or co-coding when appropriate or subcodes are difficult to differentiate.
We also developed instructions for the use of the codebook, as well as explanatory material. For example, we encourage users to adapt the codebook to their projects and to create their own examples. We also recommend that they co-code i-PARIHS subcodes, as applicable, to indicate factors that may impede implementation (barriers) and/or factors that may enhance or improve implementation (enablers). We added instructions and explanatory material based on feedback across the phases of development. For example, in response to i-PARIHS developers’ recommendations, we clarified that we developed the codebook based on our interpretation of the i-PARIHS framework.
The lack of standardized definitions of the i-PARIHS framework’s constructs and sub-constructs had resulted in the development of definitions for individual studies and limited the opportunity for comparing findings across studies that are guided by i-PARIHS. Using a rigorous, structured process, the authors developed a qualitative codebook, informed by the i-PARIHS framework, that addresses this gap. When developing the codebook, our goal was to stay as close as possible to the intent and purpose of the i-PARIHS framework. We also focused on the demands of qualitative data analysis, the challenges of assigning a priori codes to what people say during interviews, and the needs of coding teams. Thus, we sought to ensure that code labels were conceptually meaningful and clear and that definitions and instructions could be understood and applied by individuals with or without experience using i-PARIHS. Developers of the i-PARIHS framework, as well as expert panel members, asserted that the codebook is a good resource for researchers.
We do not consider the codebook a significant revision to i-PARIHS. Rather, it is a tool, a codebook informed by i-PARIHS, for individuals and teams conducting qualitative data analysis to identify and describe what has influenced innovation implementation. For the Innovation, Recipients, and Context constructs, the codebook added several subcodes for characteristics that are consistent with i-PARIHS, but not specifically mentioned, and modified the names of several others so that subcode labels were clear and inclusive. The i-PARIHS framework did not include a sub-classification of facilitation activities but did suggest how facilitators could address the characteristics of the other three constructs. We adopted and revised a list of facilitation activities from previous work that included an extensive literature review, a qualitative study of an intensive facilitation strategy conducted over two and a half years, and a scoping review of the literature. The list and definitions we adopted were informed by the PARIHS framework and our adaptations during the codebook development process were informed by literature available about the i-PARIHS framework. Thus, it is not surprising that subcodes for clustered facilitation activities and individual activities are similar to actions recommended by the framework. For example, i-PARIHS recommends goal setting and consensus building; the codebook includes subcodes for Setting goals and priorities and Developing shared vision/consensus building. It is likely that some qualitative material will need to be co-coded for multiple facilitation activities. For example, material co-coded with subcodes from the Building relationships, teams, and networks and Enabling and fostering change facilitation activities clusters may be descriptions of the i-PARIHS boundary spanning concept which consists of scanning the organizational environment and employing four different types of activities: collecting and disseminating information; developing and maintaining relationships; coordinating, aligning, and negotiating with the environment; and facilitating cooperation by mediating between different interests and identities [43, 44].
Although i-PARIHS Facilitation construct recommendations are linked to other specific constructs (e.g., problem identification is linked only to the Innovation construct), the codebook will allow users to co-code qualitative material without assuming that particular characteristics are linked (e.g., material coded with the Problem identification subcode might be co-coded with one or more of the subcodes for characteristics of the context). Additionally, although characteristics of the i-PARIHS context construct were targeted to specific levels of context (e.g., formal and informal leadership support is only a characteristic of the inner/local context), the codebook allows users to code which levels of context qualitative material are describing. Unlike actions recommended in the Facilitation guide , subcodes in the codebook are not linked a priori to specific other construct subcodes. Codebook users will be able to cross-code activities with other construct subcodes in order to explore how facilitators actually address barriers and leverage enablers related to construct characteristics, as well as how these constructs interact with each other.
Theories, models, and frameworks, i.e., i-PARIHS, are often treated as “received wisdom” that can inform research  with less emphasis on using research findings iteratively and recursively to further develop, refine, and expand them . Developers of the original framework  continued to refine PARIHS by conducting literature reviews and concept analyses [9, 47, 48], exploring evidence on users’ application of the framework , and continuing to develop and refine how the framework could be used . Two PARIHS developers continued this work by reviewing the evidence on users’ experiences with PARIHS, reviewing critiques of PARIHS, and comparing PARIHS to other frameworks and models. As a result, they revised the original framework, which is now called i-PARIHS. This history of refinement will likely continue. In addition to focusing analysis of data for individual studies, the codebook described in this paper can support the refinement of the i-PARIHS framework using empirical findings from multiple studies. Studies applying the codebook can test existing constructs and proposed relationships between their characteristics, as well as characteristics represented by subcodes we added (e.g., expansion of context codes to all levels, inclusion of additional context codes, and how facilitation activities are used to address characteristics of other constructs). CFIR framework developers have recently revised some of that framework’s constructs, sub-constructs, and definitions based on a review of literature and a survey of authors who had applied CFIR in a published study . In the future, i-PARIHS developers or others might use similar methods to further refine i-PARIHS based on evidence from studies that have applied the codebook.
There are several limitations to the development of the codebook. First, for the Facilitation construct, we focused exclusively on the activities that facilitators conduct. Facilitator skills and attributes can impact both the types and quality of activities facilitators conduct, e.g., lack of appropriate skills can potentially have a negative impact on fidelity to a planned facilitation strategy and ultimately on outcomes [50,51,52,53]. We acknowledge that evaluation of an implementation facilitation intervention should likely include an assessment of facilitators’ skills, but the addition of sub-codes for skills was beyond the scope of the workgroup. However, previous work, which identified and described facilitation skills , could form the foundation for coding facilitation skills in qualitative material. Future work should apply these and further refine descriptions for addition to the current codebook.
Second, we piloted the codebook on data collected using interview guides that were broadly informed by i-PARIHS constructs but not designed to probe for the specific construct characteristics represented by subcodes. The coding of data thus resulted in the identification of construct characteristics that were most salient to study participants and confirmed that the codebook could be applied to data. Future studies should develop and apply interview guides that include probes for construct characteristics and test the codebook to maximize its value. Finally, the codebook was developed based on the authors’ experiences conducting qualitative research and applying the PARIHS and/or i-PARIHS frameworks. Similar to developers of the CFIR, the authors are researchers embedded in the VA . Just as the CFIR has been widely utilized both within and outside of VA , we believe that the codebook we developed is also widely applicable. It is important to note that although our team created the codebook independently, i-PARIHS developers reviewed it and their input was incorporated into the final version.
This paper describes the development of a qualitative codebook informed by the i-PARIHS framework. The codebook can focus the analysis of data for individual studies, and facilitate data exploration, pattern identification, and insight development which are critical for meaningful use of TMFs in implementation studies. It also provides standardized subcodes and definitions for each of the i-PARIHS constructs and construct characteristics, maximizing the potential for comparing findings across studies informed by i-PARIHS, and advancing generalizable implementation science knowledge. Using the codebook will enable qualitative data analysts to explore interactions between the innovation, recipients, and context and how facilitators interact with these. Finally, the codebook described in this paper can support the refinement of the i-PARIHS framework using empirical findings from multiple studies.
Availability of data and materials
- BH QUERI:
Behavioral Health Quality Enhancement Research Initiative
Consolidated Framework for Implementation Research
Promoting Action on Implementation Research in Health Services
Integrated-Promoting Action on Implementation Research in Health Services
Theories, models, and frameworks
Department of Veterans Affairs
Tabak RG, Khoong EC, Chambers DA, Brownson RC. Bridging research and practice: models for dissemination and implementation research. Am J Prev Med. 2012;43(3):337–50. https://doi.org/10.1016/j.amepre.2012.05.024.
Lynch EA, Mudge A, Knowles S, Kitson AL, Hunter SC, Harvey G. “There is nothing so practical as a good theory”: a pragmatic guide for selecting theoretical approaches for implementation projects. BMC Health Serv Res. 2018;18(1):857. https://doi.org/10.1186/s12913-018-3671-z.
Eccles M, Grimshaw J, Walker A, Johnston M, Pitts N. Changing the behavior of healthcare professionals: the use of theory in promoting the uptake of research findings. J Clin Epidemiol. 2005;58(2):107–12. https://doi.org/10.1016/j.jclinepi.2004.09.002.
Grol RP, Bosch MC, Hulscher M, Eccles MP, Wensing M. Planning and studying improvement in patient care: the use of theoretical perspectives. Millbank Q. 2007;85(1):93–138. https://doi.org/10.1111/j.1468-0009.2007.00478.x.
Bergström A, Ehrenberg A, Eldh AC, Graham ID, Gustafsson K, Harvey G, et al. The use of the PARIHS framework in implementation research and practice—a citation analysis of the literature. Implement Sci. 2020;15(1):68. https://doi.org/10.1186/s13012-020-01003-0.
Birken SA, Powell BJ, Shea CM, Haines ER, Alexis Kirk M, Leeman J, et al. Criteria for selecting implementation science theories and frameworks: results from an international survey. Implement Sci. 2017;12(1):124. https://doi.org/10.1186/s13012-017-0656-y.
Harvey G, Kitson A. Implementing evidence-based practice in healthcare: a facilitation guide. London: Routledge; 2015.
Kitson A, Harvey G, McCormack B. Enabling the implementation of evidence based practice: a conceptual framework. Qual Health Care. 1998;7(3):149–58. https://doi.org/10.1136/qshc.7.3.149.
McCormack B, Kitson A, Harvey G, Rycroft-Malone J, Titchen A, Seers K. Getting evidence into practice: the meaning of ‘context’. J Adv Nurs. 2002;38(1):94–104. https://doi.org/10.1046/j.1365-2648.2002.02150.x.
Kitson AL, Rycroft-Malone J, Harvey G, McCormack B, Seers K, Titchen A. Evaluating the successful implementation of evidence into practice using the PARiHS framework: theoretical and practical challenges. Implement Sci. 2008;3(1):1–12. https://doi.org/10.1186/1748-5908-3-1.
Helfrich C, Damschroder L, Hagedorn H, Daggett G, Sahay A, Ritchie M, et al. A critical synthesis of literature on the Promoting Action on Research Implementation in Health Services (PARIHS) framework. Implement Sci. 2010;5(1):82. https://doi.org/10.1186/1748-5908-5-82.
Stetler CB, Damschroder LJ, Helfrich CD, Hagedorn HJ. A Guide for applying a revised version of the PARIHS framework for implementation. Implement Sci. 2011;6(1):99. https://doi.org/10.1186/1748-5908-6-99.
Rycroft-Malone J, Seers K, Chandler J, Hawkes CA, Crichton N, Allen C, et al. The role of evidence, context, and facilitation in an implementation trial: implications for the development of the PARIHS framework. Implement Sci. 2013;8:28. https://doi.org/10.1186/1748-5908-8-28.
Steffen KM, Holdsworth LM, Ford MA, Lee GM, Asch SM, Proctor EK. Implementation of clinical practice changes in the PICU: a qualitative study using and refining the iPARIHS framework. Implement Sci. 2021;16(1):15. https://doi.org/10.1186/s13012-021-01080-9.
Harvey G, Llewellyn S, Maniatopoulos G, Boyd A, Procter R. Facilitating the implementation of clinical technology in healthcare: what role does a national agency play? BMC Health Serv Res. 2018;18(1):347. https://doi.org/10.1186/s12913-018-3176-9.
Chinman M, Daniels K, Smith J, McCarthy S, Medoff D, Peeples A, et al. Provision of peer specialist services in VA patient aligned care teams: protocol for testing a cluster randomized implementation trial. Implement Sci. 2017;12(1):57. https://doi.org/10.1186/s13012-017-0587-7.
Hunter SC, Kim B, Kitson AL. Interactive workshop to develop implementation framework (i-PARIHS) resources to support practice facilitation. Implement Sci Commun. 2020;1(1):56. https://doi.org/10.1186/s43058-020-00046-0.
Byrnes A, Young A, Mudge A, Banks M, Clark D, Bauer J. Prospective application of an implementation framework to improve postoperative nutrition care processes: evaluation of a mixed methods implementation study. Nutr Diet. 2018;75(4):353–62. https://doi.org/10.1111/1747-0080.12464.
Harvey G, Kitson A. PARIHS revisited: from heuristic to integrated framework for the successful implementation of knowledge into practice. Implement Sci. 2016;11(1):1–13. https://doi.org/10.1186/s13012-016-0398-2.
Nilsen P, Bernhardsson S. Context matters in implementation science: a scoping review of determinant frameworks that describe contextual determinants for implementation outcomes. BMC Health Serv Res. 2019;19(1):189. https://doi.org/10.1186/s12913-019-4015-3.
Perry CK, Damschroder LJ, Hemler JR, Woodson TT, Ono SS, Cohen DJ. Specifying and comparing implementation strategies across seven large implementation interventions: a practical application of theory. Implement Sci. 2019;14(1):32. https://doi.org/10.1186/s13012-019-0876-4.
Mazzucca S, Tabak RG, Pilar M, Ramsey AT, Baumann AA, Kryzer E, et al. Variation in research designs used to test the effectiveness of dissemination and implementation strategies: a review. Front. Public Health. 2018;6(32). https://doi.org/10.3389/fpubh.2018.00032.
Sales A, Smith J, Curran G, Kochevar L. Models, strategies, and tools. Theory in implementing evidence-based findings into health care practice. J Gen Intern Med. 2006;21(s2):S43–S9. https://doi.org/10.1007/s11606-006-0274-x.
Moullin JC, Dickson KS, Stadnick NA, Albers B, Nilsen P, Broder-Fingert S, et al. Ten recommendations for using implementation frameworks in research and practice. Implement Sci Commun. 2020;1(1):42. https://doi.org/10.1186/s43058-020-00023-7.
RE-AIM Website. https://www.re-aim.org/. Accessed: 25 Jan 2022.
Atkins L, Francis J, Islam R, O’Connor D, Patey A, Ivers N, et al. A guide to using the Theoretical Domains Framework of behaviour change to investigate implementation problems. Implement Sci. 2017;12(1):77. https://doi.org/10.1186/s13012-017-0605-9.
Miles MB, Huberman AM, Saldaña J. Qualitative data analysis: a methods sourcebook. Thousand Oaks: Sage; 2014.
Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4(1):50. https://doi.org/10.1186/1748-5908-4-50.
Consolidated Framework for Implementation Research (CFIR). https://cfirguide.org/. Accessed: 15 Aug 2018.
May CR, Albers B, Bracher M, Finch TL, Gilbert A, Girling M, et al. Translational framework for implementation evaluation and research: a normalisation process theory coding manual for qualitative research and instrument development. Implement Sci. 2022;17(1):19. https://doi.org/10.1186/s13012-022-01191-x.
Aarons GA, Hurlburt M, Horwitz SM. Advancing a conceptual model of evidence-based practice implementation in public service sectors. Admin Pol Ment Health. 2011;38(1):4–23. https://doi.org/10.1007/s10488-010-0327-7.
Moullin JC, Dickson KS, Stadnick NA, Rabin B, Aarons GA. Systematic review of the Exploration, Preparation, Implementation, Sustainment (EPIS) framework. Implement Sci. 2019;14(1):1. https://doi.org/10.1186/s13012-018-0842-6.
Ritchie MJ, Kirchner JE, Parker LE, Curran GM, Fortney JC, Pitcock JA, et al. Evaluation of an implementation facilitation strategy for settings that experience significant implementation barriers. Implement Sci. 2015;10(1):A46. https://doi.org/10.1186/1748-5908-10-s1-a46.
Smith JL, Ritchie MJ, Kim B, Miller CJ, Chinman MJ, Kelly PA, et al. Getting to fidelity: scoping review and expert panel process to identify core activities of implementation facilitation strategies. SocArXiv. 2022. Preprint available at: https://osf.io/preprints/socarxiv/6xfvj/.
Stetler CB, Mittman BS, Francis J. Overview of the VA Quality Enhancement Research Initiative (QUERI) and QUERI theme articles: QUERI Series. Implement Sci. 2008;3(8). https://doi.org/10.1186/1748-5908-3-8.
Kitson AL, Harvey G. Methods to succeed in effective knowledge translation in clinical practice. J Nurs Scholarsh. 2016;48(3):294–302. https://doi.org/10.1111/jnu.12206.
Rycroft-Malone J. The PARIHS Framework-a framework for guiding the implementation of evidence-based practice. J Nurs Care Qual. 2004;19(4):297–304. https://doi.org/10.1097/00001786-200410000-00002.
Rycroft-Malone J, Harvey G, Seers K, Kitson A, McCormack B, Titchen A. An exploration of the factors that influence the implementation of evidence into practice. J Clin Nurs. 2004;13(8):913–24. https://doi.org/10.1111/j.1365-2702.2004.01007.x.
Kitson A, Brook A, Harvey G, Jordan Z, Marshall R, O’Shea R, et al. Using complexity and network concepts to inform healthcare knowledge translation. Int J Health Policy Manag. 2018;7(3):231–43. https://doi.org/10.15171/ijhpm.2017.79.
Wray LO, Ritchie MJ, Oslin DW, Beehler GP. Enhancing implementation of measurement-based mental health care in primary care: a mixed-methods randomized effectiveness evaluation of implementation facilitation. BMC Health Serv Res. 2018;18(1):753. https://doi.org/10.1186/s12913-018-3493-z.
Bauer MS, Weaver K, Kim B, Miller C, Lew R, Stolzmann K, et al. The collaborative chronic care model for mental health conditions: from evidence synthesis to policy impact to scale-up and spread. Med Care. 2019;57(10 Suppl 3):S221. https://doi.org/10.1097/MLR.0000000000001145.
Sullivan JL, Kim B, Miller CJ, Elwy AR, Drummond KL, Connolly SL, et al. Collaborative chronic care model implementation within outpatient behavioral health care teams: qualitative results from a multisite trial using implementation facilitation. Implement Sci Commun. 2021;2(1):33. https://doi.org/10.1186/s43058-021-00133-w.
van Meerkerk I, Edelenbos J. Boundary spanners in public management and governance: an interdisciplinary assessment. Cheltenham: Edward Elgar Publishing; 2018.
van Meerkerk I, Edelenbos J. Becoming a competent boundary spanning public servant. In: Sullivan H, Dickinson H, Henderson H, editors. The Palgrave Handbook of the Public Servant. Cham: Palgrave Macmillan; 2021. p. 1437–52.
Kislov R. Engaging with theory: from theoretically informed to theoretically informative improvement research. BMJ Qual Saf. 2019;28(3):177–9. https://doi.org/10.1136/bmjqs-2018-009036.
Kislov R, Pope C, Martin GP, Wilson PM. Harnessing the power of theorising in implementation science. Implement Sci. 2019;14(1):103. https://doi.org/10.1186/s13012-019-0957-4.
Harvey G, Loftus-Hills A, Rycroft-Malone J, Titchen A, Kitson A, McCormack B, et al. Getting evidence into practice: the role and function of facilitation. J Adv Nurs. 2002;37(6):577–88. https://doi.org/10.1046/j.1365-2648.2002.02126.x.
Rycroft-Malone J, Seers K, Titchen A, Harvey G, Kitson A, McCormack B. What counts as evidence in evidence-based practice? J Adv Nurs. 2004;47(1):81–90. https://doi.org/10.1111/j.1365-2648.2004.03068.x.
Damschroder L, Reardon CM, Opra Widerquist MA, Lowery JC. The updated Consolidated Framework for Implementation Research: CFIR 2.0. 2022. Manuscript under review, preprint available at: https://doi.org/10.21203/rs.3.rs-1581880/v1.
Due TD, Thorsen T, Waldorff FB, Kousgaard MB. Role enactment of facilitation in primary care – a qualitative study. BMC Health Serv Res. 2017;17(1):593. https://doi.org/10.1186/s12913-017-2537-0.
Seers K, Rycroft-Malone J, Cox K, Crichton N, Edwards RT, Eldh AC, et al. Facilitating Implementation of Research Evidence (FIRE): an international cluster randomised controlled trial to evaluate two models of facilitation informed by the Promoting Action on Research Implementation in Health Services (PARIHS) framework. Implement Sci. 2018;13(1):137. https://doi.org/10.1186/s13012-018-0831-9.
Baloh J, Zhu X, Ward MM. Types of internal facilitation activities in hospitals implementing evidence-based interventions. Health Care Manag Rev. 2018;43(3):229–37. https://doi.org/10.1097/hmr.0000000000000145.
Rycroft-Malone J, Seers K, Eldh AC, Cox K, Crichton N, Harvey G, et al. A realist process evaluation within the Facilitating Implementation of Research Evidence (FIRE) cluster randomised controlled international trial: an exemplar. Implement Sci. 2018;13(1):138. https://doi.org/10.1186/s13012-018-0811-0.
Ritchie MJ, Parker LE, Kirchner JE. From novice to expert: a qualitative study of implementation facilitation skills. Implement Sci Commun. 2020;1(1):7. https://doi.org/10.1186/s43058-020-00006-8.
Kirk MA, Kelley C, Yankey N, Birken SA, Abadie B, Damschroder L. A systematic review of the use of the Consolidated Framework for Implementation Research. Implement Sci. 2016;11(1):72. https://doi.org/10.1186/s13012-016-0437-z.
The authors thank the following individuals for the significant amount of time they gave and the important contributions they made to the development of this codebook by participating in an intensive expert panel process: Gregory P. Beehler, PhD; Bo Kim, PhD; JoAnn E. Kirchner, MD; Lindsey A. Martin, PhD; Christopher J. Miller, PhD; Amanda D. Peeples, PhD; Jeffrey L. Smith; and Natalie (Kiddie) Vineyard, MS. The authors also thank i-PARIHS developers, Drs. Gill Harvey and Alison Kitson, and Dr. Sarah Hunter for their willingness to review the draft codebook and for the invaluable feedback they provided. We also thank the organizational scientist and qualitative methodology expert, Louise Parker, PhD, for her contributions to the workgroup’s understanding of organizational context.
This study was supported by funding from the Department of Veterans Affairs Quality Enhancement Research Initiative (QUERI), QUE 15-289 and QUE 20-026. The funding body had no involvement in the design of the development process, in the development of the codebook, or in the writing of the manuscript. The views expressed in this article are those of the authors and do not represent the views of the US Department of Veterans Affairs or the United States Government.
Ethics approval and consent to participate
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Literature that informed development of the i-PARHIS codebook. Literature WG members reviewed to identify and define subcodes for i-PARIHS construct characteristics.
A qualitative codebook informed by the i-PARIHS framework. Qualitative codebook, informed by the i-PARIHS framework, that includes sub-codes and definitions for each of the framework’s constructs and instructions for using the codebook.
About this article
Cite this article
Ritchie, M.J., Drummond, K.L., Smith, B.N. et al. Development of a qualitative data analysis codebook informed by the i-PARIHS framework. Implement Sci Commun 3, 98 (2022). https://doi.org/10.1186/s43058-022-00344-9