Skip to main content
Download PDF
Download ePub

CENTER-IT: a novel methodology for adapting multi-level interventions using the Consolidated Framework for Implementation Research—a case example of a school-supervised asthma intervention

Implementation Science Communications volume 3, Article number: 33 (2022) Cite this article

Abstract

Background

Implementation science frameworks advise the engagement of multi-level partners (at the patient, provider, and systems level) to adapt and increase the uptake of evidence-based practices (EBPs). However, there is little guidance to ensure that systems-level adaptations reflect the voices of providers who deliver and patients/caregivers who receive EBPs.

Methods

We present a novel methodology, grounded in the Consolidated Framework for Implementation Research (CFIR), which anchors the engagement of multi-level partners to the voices of individuals who deliver and receive EBPs. Using the CFIR domains: intervention adaptation, individuals involved, inner/outer setting, and process, we illustrate our 4-step methodology through a case example of Asthma Link, a school-supervised asthma management intervention. In step 1, we interviewed “individuals involved” in the intervention (providers/caregivers/patients of Asthma Link) to identify implementation barriers. In step 2, we selected systems-level partners in the “inner and outer setting” that could assist with addressing these barriers. In step 3, we presented the barriers to these systems-level partners and conducted semi-structured interviews to elicit their recommended solutions (process). Interviews were audio-recorded, transcribed, and open-coded. A theoretical sampling model and deductive reasoning were used to identify solutions to implementation barriers. In step 4, we utilized multi-level input to adapt the Asthma Link intervention.

Results

Identified barriers included inability to obtain two inhalers for home and school use, inconsistent delivery of the inhaler to school by families, and challenges when schools did not have a nurse. Interviews conducted with school/clinic leaders, pharmacists, payors, legislators, and policymakers (n=22) elicited solutions to address provider and patient/caregiver-identified barriers, including (1) establishing a Medicaid-specific pharmacy policy to allow dispensation of two inhalers, (2) utilizing pharmacy-school delivery services to ensure medication reaches schools, and (3) identifying alternate (non-nurse) officials to supervise medication administration. The iterative process of engaging multi-level partners helped to create an adapted Asthma Link intervention, primed for effective implementation.

Conclusions

This novel methodology, grounded in the CFIR, ensures that systems-level changes that require the engagement of multi-level partners reflect the voices of individuals who deliver and receive EBPs. This methodology demonstrates the dynamic interplay of CFIR domains to advance the field of implementation science.

Peer Review reports

Background

Implementation frameworks, including the Consolidated Framework for Implementation Research (CFIR), call for the involvement of multi-level partners (at the patient, provider, and systems level) throughout the implementation research process to adapt interventions and promote effective implementation and sustainability of evidence-based practices [1,2,3]. However, there is little guidance on how to ensure that changes at the systems-level integrate multi-level perspectives, including those of providers who deliver interventions and patients and caregivers who receive and utilize interventions.

Multi-level partners have been increasingly involved in the process of adapting evidence-based interventions (EBPs) for effective implementation [4, 5], yet systems-level partners often make decisions without input from those individuals directly affected by interventions. The voices of providers and patients need to be heard by systems-level partners, to promote decisions and adaptations that overcome implementation barriers on the ground level [6]. Recognizing this, “patient needs and resources” has been proposed as its own domain in a pragmatic adaptation to the CFIR [7]. Incorporating the voices of both the deliverers and recipients of interventions, specifically with user-centered design, improves provider delivery, receptivity, and patient uptake of EBPs [8]. Theoretical approaches depict engagement as a process that is key to implementation without clearly defining the term “engagement.” The CFIR places “engagement” within several domains (process, individuals involved, inner and outer setting); however, there is little explanation on how one domain influences another [4]. Moreover, within the CFIR, little research has been done to gain an understanding of the dynamic interplay between individuals and the organization in which they work and how that interplay influences individual or organizational behavior [1].

To address these gaps, we present a new methodology: CENTER-IT (CENTERing multi-level partner voices in Implementation Theory) which is grounded in the CFIR. The five CFIR domains are characteristics of the intervention, characteristics of the individuals involved, inner setting, outer setting, and process [1]. The CENTER-IT approach provides guidance on how to engage multi-level partners to connect all five CFIR domains and anchors the engagement of multi-level partners to the voices of individuals who deliver and receive EBPs. The purpose of this study is to describe the CENTER-IT methodology and how it was used to adapt an evidence-based intervention to promote implementation, based on stakeholder perspectives of implementation determinants at multiple levels.

Methods

Case study: school-supervised asthma therapy for children

In this case study, the CENTER-IT methodology is exhibited through multi-level partner engagement in the implementation of school-supervised asthma therapy. School-supervised asthma therapy is an EBP that has improved preventive medication adherence and asthma symptoms among children who are in racial/ethnic minority groups and low-income socioeconomic conditions [9,10,11,12]. However, this strategy has not been widely adopted in practice to produce meaningful public health impact for these populations. Asthma Link is a school-supervised therapy intervention in central Massachusetts, developed to increase the uptake of this EBP, in part by leveraging the existing infrastructure of pediatric practices and school nurses, rather than research resources, to operate. The details of this intervention have been previously published [13]. In brief, pediatric providers identify children with poorly controlled asthma in their practice and send medication orders to the child’s school to initiate school-supervised therapy. Families are asked to bring a preventive inhaler into the school and school nurses supervise its administration, ensuring daily adherence [13]. Approximately sixty to one hundred children with poorly controlled asthma are enrolled in Asthma Link each school year and enrolled children experience significant decreases in emergency room visits, hospital admissions, and rescue medicine use [13]. While patients/caregivers, medical providers, and school nurses have found this intervention acceptable, they also identified barriers to successful implementation in practice [14].

This research is responding to the problem that most pediatric practices are not implementing school-supervised therapy and those that are implementing this EBP do not enroll a high number of participants. The desired outcomes would be to increase pediatric practice and patient participation in the evidence-based practice of school-supervised asthma therapy, through using Asthma Link.

The goal of this case study is to describe our CENTER-IT methodology and how it elucidates the interaction between CFIR domains when working to improve implementation of EBPs. We will describe the CENTER-IT methodology, as it was applied to the Asthma Link case study, to demonstrate the process that ensures that recipient (patient/caregiver) and deliverer (school nurse and medical provider)-identified implementation barriers are used to guide systems-level partner engagement. This engagement process is intended to inform adaptations to the intervention which overcome and address these implementation barriers.

We chose the CFIR as the framework to tailor this intervention because it is a comprehensive framework for determining barriers and facilitators to multi-level interventions, draws particular attention to the intervention setting (both inner and outer setting), guides implementation of evidence-based practices from the phases of design to evaluation, and specifically has been effectively used for adaptation of care model designs, including those for asthma [1, 7, 15, 16]. We defined our study components according to the five CFIR domains, intervention characteristics, characteristics of individuals involved, inner setting, outer setting, and process, and associated constructs [1]. The CFIR domain “intervention characteristics” corresponds to our asthma intervention as described above, and the construct “adaptability” within this domain corresponds to the degree to which our intervention can be tailored to meet local needs. The CFIR domain “characteristics of individuals involved” and the construct “knowledge and beliefs about the intervention” correspond to the providers (pediatric providers and school nurses) who deliver and the patients/caregivers who receive school-supervised asthma therapy and their perceived barriers and facilitators to implementation. The CFIR domain “inner setting” and construct “structural characteristics” correspond to the organizations of the clinics and the schools where this intervention is implemented. The “outer setting” domain and construct “external policies and incentives” correspond to the market, policy, and legislative context which influence the operation of the intervention. Collectively, the inner and outer setting are defined as the systems level. The CFIR domain “process” and the construct “engaging opinion leaders and external change agents” correspond to the dynamic process of engagement of multi-level partners to create an “adapted intervention” which is primed for effective implementation.

Four-step CENTER-IT methodology for multi-level engagement (Fig. 1)

Step 1: interview providers who deliver and patients/caregivers who receive EBPs to identify implementation barriers (CFIR domain: individuals involved)

The results of this first step in our methodology were previously published [14]. In brief, we interviewed Asthma Link patients and their caregivers, pediatric providers, and school nurses. Barriers reported included medical providers not having time to identify potentially eligible patients during clinical encounters, inability of families to obtain a second inhaler for school, challenges with delivery of the second inhaler to the school, absences in school nurse coverage to supervise medications, and concerns about dissemination and sustainability of the program [14].

Fig. 1
figure 1

CENTER-IT: centering multi-level partner voices in implementation theory—empiric use of the CFIR

Full size image

Step 2: select partners in the inner and outer setting of the intervention to interview, based on barriers identified by providers and patients/caregivers (CFIR domains: inner and outer setting)

An expert consensus group was created which included 2 pediatric pulmonologists and 4 behavioral scientists. Based on the provider- and patient/caregiver-identified barriers, this expert consensus group used purposive selection to determine which stakeholders in the inner and outer setting could assist with systems-level solutions to address these barriers (CFIR domain: inner and outer setting, constructs: structural characteristics and engaging opinion leaders and external change agents). The research team contacted the following systems-level groups to request interviews in the inner setting: five school administrators selected from the three schools enrolling the highest numbers of Asthma Link participants, four pediatric practice managers from two pediatric practices implementing Asthma Link, and four pharmacists from the most highly utilized four pharmacies. We contacted the following groups in the outer setting: health insurance officials including three officials in Medicaid payment services, the most highly utilized insurance by Asthma Link participants, plus one official in payment services in a private insurance company that was next highly utilized; three Massachusetts legislators with experience in child health intervention policy and child health equity; and five officials from the Massachusetts Department of Public Health with roles in early education and school-based health at the state level.

Research staff approached these partners via phone or email to request time for an interview. A maximum of two emails or phone calls were made; participation in the interview was voluntary and no compensation was provided.

Step 3: present implementation barriers identified by the individuals involved in the intervention, to partners in the inner and outer setting to elicit their recommended solutions (CFIR domains: process, individuals involved, inner and outer setting)

We presented the provider- and patient/caregiver-identified barriers to the partners selected from the inner and outer setting in step 2 and conducted semi-structured interviews with them to elicit their recommended systems-level solutions to these implementation issues.

We developed an interview guide for these systems-level stakeholders with fixed open-ended questions and probes to elicit input (Table 1). We developed questions within ten constructs, derived from the previously identified barriers: (1) Asthma Link Awareness, (2) Completing Asthma Link Enrollment, (3) Current Practice, (4) Receiving Medications at School, (5) Obtaining Two Inhalers, (6) Delivery of Inhaler to School, (7) Other Asthma Link Implementation Barriers, (8) Stakeholder Priorities, (9) Dissemination of Asthma Link, and (10) Sustainability of Asthma Link.

Table 1 Use of CFIR domains to select systems-level partners and develop interview questions for the CENTER-IT methodology: Asthma Link case study
Full size table

Data collection

Researchers trained in qualitative methods conducted semi-structured interviews over the telephone between November 2019 and June 2020. The researchers had no established relationships with the study participants. A fact sheet was reviewed with the participant and interviews were conducted in a private setting. The interview guide contained a mix of open- and closed-ended questions. For each systems-level group, we asked questions related to the specific barriers identified by Asthma Link participants to seek input on optimal ways to overcome and address these challenges (Table 1). Probes and follow-up questions were used throughout the phone interview as needed. Each interview lasted between 30 and 45 min and all were audio recorded. The Institutional Review Board at the University of Massachusetts Medical School approved this study.

Step 4: adapt intervention protocol using multi-level input

Finally, we incorporated this multi-level input to understand implementation determinants at multiple levels and develop adaptations to the Asthma Link intervention protocol. An expert consensus group was created which included two pediatric pulmonologists and four behavioral scientists, who examined this input from partners on the implementation determinants at multiple levels and utilized this data to inform adaptations to the intervention. This expert consensus group closely considered the risks of creating adaptations to the intervention, with regard to compromising fidelity, effectiveness, and appropriateness of the intervention with attention to the compromise between fidelity and fit of these adaptations [17].

Qualitative analysis

A third party transcribed the recorded interviews, checked for accuracy, and stripped identifying information. Four members of the research team (SH, MS, HS, HS), trained in qualitative analysis, performed thematic content analysis using a deductive approach, guided by the 10 a priori defined constructs [14, 18]. The CFIR was an integral part of our analysis; within each a priori construct, specific CFIR constructs guided the content analysis. An iterative, constant-comparative process was used to review, segment, and open code data into emerging themes and recurrent patterns [19]. Four team members (SH, MS, HS, HS) read five randomly selected transcripts as a group line-by-line and assigned preliminary codes to each unique topic that emerged. Following review of these transcripts, the research team refined these codes and specified indications for their use in a universal codebook [18, 20]. The remaining transcripts were coded individually by the same four team members based on the universal codebook. All coding discrepancies were resolved through consensus. Qualitative data was organized and analyzed using Dedoose software, version 8.3.17 (2020) [21]. Each team member scored greater than 80% on Dedoose coding tests, resulting in Cohen’s kappa of 1.0 and supporting interrater agreement [22, 23].

After completion of open coding, the research team used deductive thematic analysis to identify major themes according to the 10 a priori defined constructs [24], based on the previous provider- and patient/caregiver- identified barriers. Within these constructs, researchers looked for alignment in themes within and across systems-level groups and analysis continued until no new themes emerged eluding to saturation [25]. To ensure that the final themes accurately reflected the perspectives of interviewees, themes were validated by member checks: one interviewee from each of the systems-level groups was contacted by phone to present thematic results and to provide an opportunity for them to suggest changes [26, 27]. All of these partners unanimously agreed on the presented themes. The themes that informed adaptations to the Asthma Link protocol are described below.

Results

Study population

We contacted 25 systems-level partners from the inner and outer setting and 22 (88%) agreed to participate in the key informant interviews. These included Department of Public Health officials (n = 4), school administrators (n = 4), pediatric practice managers (n = 3), health insurance officials (n = 4), pharmacists (n = 4), and legislators (n = 3).

Data constructs and themes

Within the 10 a priori defined constructs, we identified 17 sub-constructs based on the qualitative input. Major themes that emerged were listed within each sub-construct. Key examples of constructs (barriers) and themes (recommended solutions) are described below.

Interactions of CFIR domains within the CENTER-IT methodology

Figure 1 presents the dynamic interaction between the five CFIR domains within the CENTER-IT methodology: individuals involved, the inner and outer setting, the process of engagement, and how the use of this methodology led to intervention adaptations to improve implementation. The findings presented below demonstrate the key products of the CENTER-IT methodology. We show the results of our 4-step process in Table 2, according to each previously identified implementation barrier: (1) the providers/patients/caregivers that identified each barrier in our previous study (CFIR domain: individuals involved), (2) the selected systems-level partners from the inner and outer setting chosen to help address the barrier (CFIR domain: inner and outer setting), (3) the solutions elicited through interviews with these systems-level partners to address the barrier (CFIR domain: process, construct: engage), and (4) the adaptations made to the Asthma Link intervention based on this multi-level input (CFIR domain: intervention adaptation). These results demonstrate not only these CFIR domains discretely but also the influence that each domain has on other domains.

Table 2 CENTER-IT methodology to adapt intervention components: Asthma Link case study
Full size table

Key examples of the themes (recommended solutions) that emerged for specific constructs (barriers) are described below.

Identifying eligible patients

Medical providers (individuals involved) identified the barrier of not having enough time to identify whether a patient was eligible for Asthma Link during clinical encounters, and thus did not introduce the program to families. Based on this, we chose to interview practice managers (inner setting) who have a systems-view of the practice. Interviews with practice managers elicited the following solution (process): practice managers reported that they could systematically identify and flag potentially eligible patients using practice-level reports. We have incorporated this recommendation into the Asthma Link practice trainings, now asking practice managers to systematically identify and flag potentially eligible patients within their practice. (intervention adaptation).

Distribution of 2 inhalers

Caregivers of patients, medical providers, and school nurses (individuals involved) identified challenges with the patient being able to receive two preventive inhalers at one time from the pharmacy: one for home and one for school use for the intervention. Based on this, we chose to interview pharmacists who dispense the medication (inner setting) and Medicaid officials who often denied the coverage of two inhalers (outer setting). Interviews with pharmacists elicited the following solution (process): pharmacists recommended that providers write “please dispense 2 inhalers, one for home and one for school- Asthma Link patient” on the prescription. We have incorporated this recommendation into the Asthma Link practice training (intervention adaptation). Interviews with Medicaid officials elicited the following information and solutions (process): the current Medicaid pharmacy policy does not automatically allow two preventive inhalers to be dispensed at one time. Therefore, in the interview, Medicaid officials recommended creating a specific Medicaid pharmacy policy to ensure prescriptions labeled with “Asthma Link patient” are permitted to fill two inhalers at the pharmacy. This solution has been incorporated into the intervention protocol and we have worked with Mass Health (state Medicaid in Massachusetts) to create this policy such that 2 inhalers can now be dispensed at one time for patients labeled “Asthma Link patient” on the prescription (intervention adaptation).

Bringing inhaler medication to school

School nurses and medical providers (individuals involved) identified the challenge of families not bringing the inhaler medicine to the school. Based on this, we chose to interview pharmacists (inner setting). They recommended that families set up mail-delivery for this medicine to be sent directly to the school from the pharmacy, as this is a free service that most pharmacies provide (process). We have incorporated this into the Asthma Link training such that providers and clinic staff are taught to educate their patients about mail-delivery pharmacy services available (intervention adaptation).

Sending medication orders from physician’s offices to schools

School nurses (individuals involved) identified challenges with receiving medication orders from physicians’ offices in a timely fashion. Based on this, we chose to interview practice directors (inner setting) who recommended that practice staff send these orders immediately after completing the phone call with the school nurse (process). This new workflow has been incorporated into the practice training and Asthma Link intervention protocol (intervention adaptation).

Absence of a school nurse to supervise medication administration

School nurses (individuals involved) reported that some schools may not always have a school nurse present to supervise medication administration. Based on this, we chose to interview school principals (inner setting), who stated that schools always have a staff member capable of supervising medication administration. They recommended identifying such individuals at schools where full-time school nurses were not present (process). The school training for Asthma Link now includes a step to identify alternate professionals capable of supervising medication administration in these situations (intervention adaptation).

Ensuring children in Asthma Link go to the school health office daily

School nurses (individuals involved) identified challenges ensuring that all children enrolled in Asthma Link go to the school health office daily to receive their medicine. Based on this, we interviewed school principals (inner setting) who recommended making the list of Asthma Link patients available to the teachers and principals so both parties could assist with this process (process). We adapted the Asthma Link intervention such that the school nurse now provides a list of Asthma Link patients to teachers and the school principal (intervention adaptation).

Gaps in school-supervised therapy during school breaks

School nurses and medical providers (individuals involved) were concerned that children would experience gaps in school-supervised therapy during the summer and school holidays. Based on this, we interviewed practice directors, school leaders (inner setting), Department of Public Health (DPH), and insurance officials (outer setting) who all recommended that a system be created to support children’s medication adherence during school breaks (summer, holidays or during remote school conditions) (process). In response, we developed Remote Asthma Link as an adaptation to traditional Asthma Link (intervention adaptation). This is an automated text message system that sends caregivers of children in the program a daily reminder for their child’s preventive inhaler, shares the text responses with school nurses and then parents and children receive a remote asthma medication check-in with a school health official on a weekly basis when school is not in session. Separate studies of this Remote Asthma Link intervention are being conducted.

Asthma Link dissemination and sustainability

Medical providers, school nurses, and patients/caregivers (individuals involved) were concerned about sustainability and dissemination of Asthma Link to new clinical practices and school districts. In response, we interviewed practice directors, school leaders (inner setting), legislators, Department of Public Health, and insurance officials (outer setting) who recommended partnering current Asthma Link leaders in clinics/schools with new clinical/school leaders who have yet to participate in Asthma Link to promote buy-in and trust in the program (process). They advised focusing on dissemination to school districts with high asthma rates. To facilitate sustainability of Asthma Link, health insurers (outer setting) recommended the presentation of data on healthcare utilization (improvements in emergency room visits and hospital admissions) and cost savings to payers and policymakers (process). The Asthma Link protocol now includes a dissemination and sustainability plan including the partnership of existing and new clinical/school leaders as well as a sustainability plan which includes the presentation of healthcare utilization and cost savings data to payers and policymakers (intervention adaptation).

Discussion

Guided by the CFIR, and through an iterative process of multi-level partner engagement, our study team developed a novel methodology to center multi-level partner voices (including those of providers, patients, and caregivers) into systems-level adaptations for the Asthma Link intervention. The CENTER-IT methodology demonstrates an empirical use of the CFIR and helps clarify the relationship between CFIR domains. Moreover, it shows the dynamic interplay between individuals involved in EBPs and the organization and context in which they work.

Through the Asthma Link case example, we showcase the CENTER-IT methodology, wherein we first elicit barriers identified by the individuals involved on the ground level of interventions and present them to systems-level partners who are well positioned to develop solutions, informing tailored intervention adaptations. The CENTER-IT approach informs the development of systems-level adaptations to interventions that are meaningful to partners at all levels (patient, caregiver, provider, and system).

The CFIR provides overarching typology to promote implementation theory; however, there is a dearth of simple reproducible examples and models for its meaningful, in-depth and pragmatic use [28]. Many implementation science frameworks, including the CFIR, focus on assessing the outer context and systems-level factors that are critical for implementation; however, the provider and patient/caregiver perspectives are not central to this process. Moreover, these frameworks have not provided clarifications on how domains or levels can interact and be synergistic. The results of the present study demonstrate not only the CFIR domains discretely but also the influence that each domain has on other domains. We employed a simple and novel methodology for the pragmatic use of the CFIR, which centers multi-level partners in systems-level changes and shows the dynamic interactions between the domains of this framework. While we applied our approach to the CFIR, it could be applied to any implementation theory or framework which recommends multi-level partner engagement to facilitate the adoption of evidence-based strategies.

The methodological approach presented in this study provides guidance to researchers on how to practically address provider and patient/caregiver-identified implementation barriers as well how to select and engage systems-level partners to address these barriers. The inclusion of these multi-level perspectives in intervention adaptation contrasts with the traditional researcher-led intervention design that often falls short of producing effective implementation in practice. This approach has the potential to identify solutions to key implementation barriers. For example, we identified the Asthma Link patient-identified barrier of “obtaining two inhalers” in step 1, then selected to interview pharmacists and Medicaid officials in step 2, elicited their recommended solutions to address this barrier in step 3, and established a MassHealth pharmacy policy to facilitate insurance coverage for two inhalers and trained providers to write “dispense two inhalers” on prescriptions in step 4. Since developing these systems-level adaptations, 100% of patients enrolled in Asthma Link for the 2020–2021 school year were able to obtain 2 preventive inhalers at one time. Noting the growing body of literature on intervention adaptations in implementation science, we must consider the feasibility, acceptability as well as intended and unintended consequences of adaptations to leverage best practice from research, so as to not compromise factors such as intervention fidelity and appropriateness [29, 30]. Future work will closely examine the feasibility, acceptability, and impact of these protocol adaptations through retrospective application of the Model for Adaptation Design and Impact [29] and detailed assessment of implementation outcomes in a hybrid effectiveness-implementation trial of the adapted Asthma Link protocol.

There are several strengths to this study. First, we developed a simple model of participatory implementation science and co-creation of an adapted intervention, strategies that are key to effective knowledge translation [31]. This model not only builds on an existing implementation science framework but can also be applied to other implementation theories or frameworks to promote the uptake of EBPs. Second, we demonstrated a novel and empiric use of a widely accepted implementation framework, starting upstream in the research process at the intervention design and adaptation phase, addressing an identified gap in implementation science [28]. Third, we meaningfully engaged partners at multiple levels (patient, provider, organizational, payer and policy) with the goal of advancing health equity by supporting improved uptake of EBPs by patients and families most in need. This heeds the recommendations of the National Institutes of Health, Patient Centered Outcomes Research Institute, and multiple implementation science frameworks [5]. The limitations include the small sample size; however, we stopped interviews at thematic saturation according to the tenets of qualitative research and our sample size is outweighed by the unique and impactful input from these stakeholders. Herein, we focused on one intervention, and it would be useful to see the CENTER-IT approach applied to other evidence-based practices.

Conclusions

As we strive to advance implementation science, through more meaningful use of implementation frameworks and amplification of participant voices, this study demonstrates the use of the CENTER-IT methodology to engage with multi-level partners to facilitate these processes. The CENTER-IT methodology anchors the engagement of multi-level partners to the voices of the individuals who deliver and receive evidence-based interventions. The goal of this methodology is to understand multi-level implementation determinants and inform adaptations to EBPs that reflect participant perspectives and improve implementation. Future work should evaluate the extent to which multi-level partner engagement, using the CENTER-IT methodology, produces intervention adaptations that improve implementation of evidenced-based practices.

Availability of data and materials

The data that support the findings of this study are available on request from the corresponding author [MT]. The data are not publicly available due to their containing information that could compromise the privacy of research participants.

Abbreviations

CFIR:

Consolidated Framework for Implementation Research

EBPs:

Evidenced-based practices

References

  1. Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4:50.

    Article  Google Scholar 

  2. Harvey G, Kitson A. PARIHS revisited: from heuristic to integrated framework for the successful implementation of knowledge into practice. Implement Sci. 2016;11:33.

    Article  Google Scholar 

  3. Moullin JC, Dickson KS, Stadnick NA, Rabin B, Aarons GA. Systematic review of the Exploration, Preparation, Implementation, Sustainment (EPIS) framework. Implement Sci. 2019;14(1):1.

    Article  Google Scholar 

  4. Norris JM, White DE, Nowell L, Mrklas K, Stelfox HT. How do stakeholders from multiple hierarchical levels of a large provincial health system define engagement? A qualitative study. Implement Sci. 2017;12(1):98.

    Article  Google Scholar 

  5. Knoepke CE, Ingle MP, Matlock DD, Brownson RC, Glasgow RE. Dissemination and stakeholder engagement practices among dissemination & implementation scientists: results from an online survey. PLoS One. 2019;14(11):e0216971.

    Article  CAS  Google Scholar 

  6. Selby JV, Beal AC, Frank L. The Patient-Centered Outcomes Research Institute (PCORI) national priorities for research and initial research agenda. JAMA. 2012;307(15):1583–4.

    Article  CAS  Google Scholar 

  7. Safaeinili N, Brown-Johnson C, Shaw JG, Mahoney M, Winget M. CFIR simplified: Pragmatic application of and adaptations to the Consolidated Framework for Implementation Research (CFIR) for evaluation of a patient-centered care transformation within a learning health system. Learn Health Syst. 2020;4(1):e10201.

    PubMed  Google Scholar 

  8. Haines ER, Dopp A, Lyon AR, Witteman HO, Bender M, Vaisson G, et al. Harmonizing evidence-based practice, implementation context, and implementation strategies with user-centered design: a case example in young adult cancer care. Implement Sci Commun. 2021;2(1):45.

    Article  Google Scholar 

  9. Gerald LB, McClure LA, Mangan JM, Harrington KF, Gibson L, Erwin S, et al. Increasing adherence to inhaled steroid therapy among schoolchildren: randomized, controlled trial of school-based supervised asthma therapy. Pediatrics. 2009;123(2):466–74.

    Article  Google Scholar 

  10. Halterman JS, Szilagyi PG, Fisher SG, Fagnano M, Tremblay P, Conn KM, et al. Randomized controlled trial to improve care for urban children with asthma: results of the School-Based Asthma Therapy trial. Arch Pediatr Adolesc Med. 2011;165(3):262–8.

    Article  Google Scholar 

  11. Millard MW, Johnson PT, McEwen M, Neatherlin J, Lawrence G, Kennerly DK, et al. A randomized controlled trial using the school for anti-inflammatory therapy in asthma. J Asthma. 2003;40(7):769–76.

    Article  Google Scholar 

  12. Harrington CB, Langhans E, Shelef DQ, Savitz M, Whitmore C, Teach SJ. A pilot randomized trial of school-based administration of inhaled corticosteroids for at-risk children with asthma. J Asthma. 2018;55(2):145–51.

    Article  CAS  Google Scholar 

  13. Trivedi M, Patel J, Lessard D, et al. School nurse asthma program reduces healthcare utilization in children with persistent asthma. J Asthma. 2018;55:1131–7.

    Article  Google Scholar 

  14. Trivedi M, Patel J, Hoque S, Mizrahi R, Biebel K, Phipatanakul W, et al. Alignment of stakeholder agendas to facilitate the adoption of school-supervised asthma therapy. Pediatr Pulmonol. 2020;55(3):580–90.

    Article  Google Scholar 

  15. Shade L, Ludden T, Dolor RJ, Halladay J, Reeves K, Rees J, et al. Using the Consolidated Framework for Implementation Research (CFIR) to evaluate implementation effectiveness of a facilitated approach to an asthma shared decision making intervention. J Asthma. 2021;58(4):554–63.

    Article  Google Scholar 

  16. Reeves K, O'Hare K, Shade L, Ludden T, McWilliams A, Manning M, et al. Evaluation of a shared decision-making intervention for pediatric patients with asthma in the emergency department. Implement Sci Commun. 2020;1:22.

    Article  Google Scholar 

  17. Castro FG, Barrera M Jr, Martinez CR Jr. The cultural adaptation of prevention interventions: resolving tensions between fidelity and fit. Prev Sci. 2004;5(1):41–5.

    Article  Google Scholar 

  18. Bradley EH, Curry LA, Devers KJ. Qualitative data analysis for health services research: developing taxonomy, themes, and theory. Health Serv Res. 2007;42(4):1758–72.

    Article  Google Scholar 

  19. Green JTN. Qualitative methods for health research. 2nd ed. Thousand Oaks: London Sage Publications; 2004.

    Google Scholar 

  20. Rosofsky A, Reid M, Sandel M, Zielenbach M, Murphy J, Scammell MK. Breathe easy at home: a qualitative evaluation of a pediatric asthma intervention. Glob Qual Nurs Res. 2016;3:2333393616676154.

    PubMed  PubMed Central  Google Scholar 

  21. Dedoose, web application for managing, analyzing, and presenting qualitative and mixed method research data,. 8.3.17 ed. Los Angeles: SocioCultural Research Consultants, LLC; 2020. https://www.dedoose.com/userguide/appendix.

  22. Dedoose. User guide 2020. Available from: https://www.dedoose.com/userguide/interraterreliability/trainingcenterarticle#TrainingCenterArticle.

  23. McHugh ML. Interrater reliability: the kappa statistic. Biochem Med. 2012;22(3):276–82.

    Article  Google Scholar 

  24. Elo S, Kyngas H. The qualitative content analysis process. J Adv Nurs. 2008;62(1):107–15.

    Article  Google Scholar 

  25. Morse JM. The significance of saturation: Sage CA; 1995.

    Book  Google Scholar 

  26. Creswell JW, Miller DL. Determining validity in qualitative inquiry. Theory Pract. 2000;39(3):124–30.

    Article  Google Scholar 

  27. Birt L, Scott S, Cavers D, Campbell C, Walter F. Member checking: a tool to enhance trustworthiness or merely a nod to validation? Qual Health Res. 2016;26(13):1802–11.

    Article  Google Scholar 

  28. Kirk MA, Kelley C, Yankey N, Birken SA, Abadie B, Damschroder L. A systematic review of the use of the consolidated framework for implementation research. Implement Sci. 2016;11:72.

    Article  Google Scholar 

  29. Kirk MA, Moore JE, Wiltsey Stirman S, Birken SA. Towards a comprehensive model for understanding adaptations’ impact: the model for adaptation design and impact (MADI). Implement Sci. 2020;15(1):56.

    Article  Google Scholar 

  30. Kirk MA, Hanson LC, Weinberger M, Haines ER, Rokoske FS, Powell BJ, et al. Pilot test of an adapted intervention to improve timeliness of referrals to hospice and palliative care for eligible home health patients. J Palliat Med. 2019;22(10):1266–70.

    Article  Google Scholar 

  31. Ramanadhan S, Davis MM, Armstrong R, Baquero B, Ko LK, Leng JC, et al. Participatory implementation science to increase the impact of evidence-based cancer prevention and control. Cancer Causes Control. 2018;29(3):363–9.

    Article  Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

Research reported in this publication was supported by the National Center for Advancing Translational Sciences, National Institutes of Health (UL1TR001453-01, KL2TR001455 as well as the National Heart, Lung, And Blood Institute of the National Institutes of Health (K23HL150341) and the National Institute of Allergy and Infectious Diseases (K24AI106822). The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health. The funding sources played no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.

Author information

Authors and Affiliations

  1. Division of Pulmonary Medicine, Department of Pediatrics, University of Massachusetts Chan Medical School, S5-828, 55 Lake Ave N, Worcester, MA, 01655, USA

    Michelle Trivedi & Michelle Spano

  2. Department of Population and Quantitative Health Sciences, University of Massachusetts Chan Medical School, S5-828, 55 Lake Ave N, Worcester, MA, 01655, USA

    Michelle Trivedi, Milagros C. Rosal, Nancy Byatt, Stephenie Lemon & Lori Pbert

  3. University of Massachusetts Chan Medical School, Worcester, MA, USA

    Shushmita Hoque, Holly Shillan & Hannah Seay

  4. Division of Pulmonary Medicine, Boston Children’s Hospital, Harvard Medical School, Boston, MA, USA

    Jonathan Gaffin

  5. Division of Asthma, Allergy, and Immunology, Boston Children’s Hospital, Harvard Medical School, Boston, MA, USA

    Wanda Phipatanakul

  6. Department of Pediatrics, University of Massachusetts Chan Medical School, Worcester, MA, USA

    Arvin Garg & Sarabeth Broder-Fingert

  7. Department of Health Promotion Sciences, University of Arizona Mel and Enid Zuckerman College of Public Health, Tucson, AZ, USA

    Lynn B. Gerald

  8. Asthma and Airway Disease Research Center, University of Arizona, Tucson, AZ, USA

    Lynn B. Gerald

  9. Department of Psychiatry, University of Massachusetts Chan Medical School, Worcester, MA, USA

    Nancy Byatt

  10. Department of Obstetrics and Gynecology, University of Massachusetts Chan Medical School, Worcester, MA, USA

    Nancy Byatt

Authors
  1. Michelle Trivedi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Shushmita Hoque
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Holly Shillan
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Hannah Seay
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Michelle Spano
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Jonathan Gaffin
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Wanda Phipatanakul
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Milagros C. Rosal
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Arvin Garg
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Lynn B. Gerald
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Sarabeth Broder-Fingert
    View author publications

    You can also search for this author in PubMed Google Scholar

  12. Nancy Byatt
    View author publications

    You can also search for this author in PubMed Google Scholar

  13. Stephenie Lemon
    View author publications

    You can also search for this author in PubMed Google Scholar

  14. Lori Pbert
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

MT conceived of and designed this work, drafted the first version of the manuscript, and substantively revised the writing. SH, HS, HS, and MS acquired and analyzed the data and substantively revised the writing. JG, WP, MR, AG, and LBG substantively revised this writing. SBF, NB, SL, and LP contributed to the design of the work and substantively revised the writing. The authors read and approved the final manuscript.

Corresponding author

Correspondence to Michelle Trivedi.

Ethics declarations

Ethics approval and consent to participate

This project was approved by the Institutional Review Board at the University of Massachusetts Chan Medical School.

Consent for publication

Not applicable.

Competing interests

JG provides consulting services for Syneos Health. WP received grants and personal fees from Genentech/Novartis, Regeneron/Sanofi, and GlaxoSmithKline; provided consulting services and clinical trial support for asthma research for Genentech/Novartis, Regeneron/Sanofi, and GlaxoSmithKline; and provided clinical trial support for asthma research for Merck. NB served on advisory boards for Sage Therapeutics or their agents, Mathematica Policy Research; is a consultant for the Gerson Lehrman Group, Sage Therapeutics, or their agents and Ovia Health; received honoraria for speaking engagements from Sage Therapeutics or its agents and Miller Medical Communications; is a speaker and member of Perinatal Depression Steering Committee for Medscape; is a Medical Director of Massachusetts Child Psychiatry Access Program for Moms (MCPAP for Moms); and is an Executive Director of Lifeline for Moms. LBG received product donation from Thayer Medical Corporation. For the remaining authors, no conflicts were declared.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Trivedi, M., Hoque, S., Shillan, H. et al. CENTER-IT: a novel methodology for adapting multi-level interventions using the Consolidated Framework for Implementation Research—a case example of a school-supervised asthma intervention. Implement Sci Commun 3, 33 (2022). https://doi.org/10.1186/s43058-022-00283-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s43058-022-00283-5

Keywords

Implementation Science Communications

ISSN: 2662-2211