- Open Access
Identifying actionable strategies: using Consolidated Framework for Implementation Research (CFIR)-informed interviews to evaluate the implementation of a multilevel intervention to improve colorectal cancer screening
Implementation Science Communications volume 2, Article number: 57 (2021)
Many evidence-based interventions (EBIs) found to be effective in research studies often fail to translate into meaningful patient outcomes in practice. The purpose of this study was to identify facilitators and barriers that affect the implementation of three EBIs to improve colorectal cancer (CRC) screening in an urban federally qualified health center (FQHC) and offer actionable recommendations to improve future implementation efforts.
We conducted 16 semi-structured interviews guided by the Consolidation Framework for Implementation Research (CFIR) to describe diverse stakeholders’ implementation experience. The interviews were conducted in the participant’s clinic, audio-taped, and professionally transcribed for analysis.
We used the five CFIR domains and 39 constructs and subconstructs as a coding template to conduct a template analysis. Based on experiences with the implementation of three EBIs, stakeholders described barriers and facilitators related to the intervention characteristics, outer setting, and inner setting. Implementation barriers included (1) perceived burden and provider fatigue with EHR (Electronic Health Record) provider reminders, (2) unreliable and ineffectual EHR provider reminders, (3) challenges to providing health care services to diverse patient populations, (4) lack of awareness about CRC screening among patients, (5) absence of CRC screening goals, (6) poor communication on goals and performance, and (7) absence of printed materials for frontline implementers to educate patients. Implementation facilitators included (1) quarterly provider assessment and feedback reports provided real-time data to motivate change, (2) integration with workflow processes, (3) pressure from funding requirement to report quality measures, (4) peer pressure to achieve high performance, and (5) a culture of teamwork and patient-centered mentality.
The CFIR can be used to conduct a post-implementation formative evaluation to identify barriers and facilitators that influenced the implementation. Furthermore, the CFIR can provide a template to organize research data and synthesize findings. With its clear terminology and meta-theoretical framework, the CFIR has the potential to promote knowledge-building for implementation. By identifying the contextual determinants, we can then determine implementation strategies to facilitate adoption and move EBIs to daily practice.
Gaps still exist between identifying evidence-based intervention (EBIs), changes to practice, and improving outcomes for patients [1, 2]. EBIs for promoting cancer screening include patient-, provider-, and organization-oriented approaches are no exception. Many of these EBIs found to be effective in research studies often fail to translate into meaningful patient outcomes in practice due to the difficulty of translating EBIs into the daily clinical workflow . This failure is particularly evident among safety-net health systems, such as federally qualified health centers (FQHCs) that provide care to low-income, uninsured, and minority patients due to resource constraints, lack of support, and competing demands. The implementation of EBIs is a complex process . It involves attention to various factors at different levels related to the intervention itself, the local implementation context, interactions within and across health care delivery organizations, and the strategies used to implement the interventions [5,6,7]. Implementation strategies used to implement an intervention are the “how-to” component of changing healthcare practice . Studying the implementation process can yield critical information on the determinants that influence implementation and, subsequently, the outcome achievement [9,10,11]. However, large knowledge gaps remain regarding “how-to” move EBIs into daily practice.
Numerous theories and models have been proposed to assess potential contextual determinants and inform the implementation of innovations [12, 13]. The Consolidated Framework for Implementation Research (CFIR)  is a well-operationalized and widely used framework to assess potential barriers and facilitators within local settings. This study aimed to (1) use CFIR to identify facilitators and barriers affecting the implementation of three EBIs with a large urban FQHC, (2) offer actionable implementation strategies to improve the EBI’s implementation efforts in a new study, and (3) expand the implementation science literature regarding the feasibility of using CFIR as a pragmatic guiding framework for an evaluation and a template to organize research data. Two of the EBIs were “provider-oriented,” meaning they increased the likelihood that providers would recommend screening; these EBIs were provider reminders and provider assessments and feedback [15, 16]. However, completion of screening involves patient compliance with provider recommendations. The third EBI was patient navigation (CRC steward), which has been widely used to improve CRC screening compliance [17,18,19,20,21,22,23,24,25] and recommended by NIH as an evidence-based strategy for CRC screening . By interviewing diverse stakeholders across four primary care clinics, we aimed to describe factors that hinder or promote the implementation of EBIs in order to improve the rates of CRC screening.
This study is part of a larger program entitled “Accelerating Colorectal Cancer Screening and Follow-up through Implementation Science-Chicago (ACCSIS-Chicago).” The ACCSIS-Chicago project is part of the NCI-funded consortium, the Accelerating CRC Screening and Follow-up through Implementation Science (ACCSIS) Program. The overall aim of ACCSIS is to conduct multi-site, coordinated, and transdisciplinary research to evaluate and improve CRC screening processes using implementation science strategies. The ACCSIS-Chicago Program aims to implement a multilevel, multicomponent intervention to increase rates of CRC screening, follow-up, and referral-to-care at four FQHCs located in Illinois and Indiana. Findings from this study are used to inform the implementation process of the multilevel intervention in these four FQHCs. This study has been reviewed and approved by the University of Chicago Institutional Review Board (IRB18-1141).
The Consolidated Framework for Implementation Research (CFIR) synthesized and categorized constructs across different theories and models and provided a meta-theoretical framework to advance our understanding of implementation across various settings and interventions. The CFIR is composed of five major domains: (1) intervention characteristics, (2) inner setting, (3) outer setting, (4) characteristics of individual involved in the implementation, and (5) implementation process. There are 39 CFIR constructs and subconstructs under these five domains, which reflect the evidence base of factors most likely to affect the implementation of interventions . Much of the research using the CFIR to date has been qualitative [27,28,29,30,31,32,33,34], with some studies using the CFIR to organize emerging themes following data collection [35,36,37]. The CFIR can also be used to guide formative evaluations and exploration into the question of which factors influenced implementation and how implementation influenced the performance of the intervention.
In this study, we conducted a formative evaluation using a qualitative study design to gain insights into the implementation process. Clinic providers and staff members involved in the implementation process were selected for one-on-one semi-structured interviews. We used CFIR to guide the evaluation process, from developing interview questions and organizing the coding tree to analyzing data and summarizing findings . Through qualitative interviews with diverse stakeholders, we aimed to describe the implementation experience, identify factors that hindered or facilitated the implementation process, and offer mitigation strategies to improve the implementation process. Figure 1 shows the conceptual framework for this qualitative study.
We conducted semi-structured interviews to assess the implementation experiences of three EBIs that were ongoing in four primary care clinics in an urban FQHC. The FQHC has 11 clinics, with 8 providing primary care services. In 2018, the FQHC provided care to 26,102 unique patients. Over 82% of patients came from racial/ethnic minority groups, nearly one third of patients were uninsured (32%), and 32% were best served in a language other than English. At the beginning of 2016, the FQHC participated in a Centers for Disease Control and Prevention (CDC) funded CRC Control Program and started implementing three EBIs to improve screening rates at its primary care clinics with technical support from the University of Chicago program team. The three EBIs implemented to promote CRC screening include (1) provider reminder, which was generated manually by staff members along with an automated reminder from the Electronic Health Record (EHR); (2) quarterly provider assessment and feedback with the clinic- and individual provider-specific reports capturing CRC screening order rates and screening completion rates; and (3) CRC stewards (integrated care specialists) to identify patients who needed CRC screening, provide patient education and follow-up with patients to ensure compliance with screening orders. CRC screening rate at the FQHC has been improving, changing from 33.6% in 2016 and 37% in 2017 to 41% by the end of 2018.
The FQHC had a total of 48 primary care providers in September 2018 when the sampling procedure began. The primary care providers included 22 physicians, 20 advanced nursing practitioners, and 6 physician assistants. We selected 8 physicians, 4 advanced nursing practitioners, and 2 physician assistants based on their overall individual CRC screening order rates in 2017. Of the 14 providers, 6 were high performers with an order rate at the top 25%, and 4 were low performers with an order rate at the lowest 25%. The range of individual CRC order rates from the selected primary care providers was between 25% and 81%, and the average order rate was 41%. The sample also included all four CRC stewards (integrated care specialists) and two administrators. We requested one on one interviews with primary care providers, CRC stewards (integrated care specialists), and administrators via email. The semi-structured interviews were conducted between November 2018 and December 2018. Participants who completed the interview received an honorarium of $50 for their time and efforts. Of the 14 primary care providers invited for the interviews, three providers no longer worked at the FQHC at the time of interviews, and one refused to participate. Thus, the final sample of the semi-structured interviews included ten primary care providers, four CRC stewards (integrated care specialists), and two administrators.
We used the publicly available CFIR Interview Guide Tool to inform our semi-structured interview guide . The semi-structured interview guide included questions within the five CFIR domains and items relevant to the study and the implemented EBIs (Table 1). Interviews began by describing the CRC Control Program and the three EBIs implemented in the interviewees’ clinics. Five trained qualitative researchers (HL, MQ, BP, TC, EK) conducted in-person, semi-structured interviews with key informants between November 2018 and December 2018. The semi-structured interviews lasted 25 min to 45 min and were audio-recorded and professionally transcribed. All interviews were conducted in the participant’s clinic. Data collection continued until all selected participants completed the interviews (Table 1).
We conducted a template analysis of interview transcripts to identify themes describing facilitators and barriers to implementing the three EBIs related to CFIR constructs. Template analysis is a form of thematic analysis that emphasizes hierarchical coding and allows a relatively high degree of structure in analyzing the textual data with the flexibility to meet a particular study’s needs . Instead of developing a coding template using a subset of data for the study, we adopted the CFIR constructs as our coding template. Figure 2 shows the coding tree for this qualitative study with codes that were identified from the data analysis. The 39 CFIR constructs and subconstructs were identified as a priori codes for an initial codebook. The colored boxes were codes identified in the interviews.
Before starting the coding process, the coders (HL, MQ, TC, EK) reviewed and discussed the CFIR coding definition, inclusion criteria, and exclusion criteria to come to a collective understanding of the codes. Due to the expansiveness of CFIR constructs, two coders independently double-coded the same transcripts and met regularly to review coding consistency and discuss problematic constructs. The coding team met together after all the transcripts were coded to discuss preliminary themes to reach a consensus. All coding and analysis were conducted in NVivo 12.
We conducted interviews with 16 stakeholders involved in various aspects of the implementation process, such as monitoring the implementation, championing the EBIs, and carrying out the EBIs. Table 2 summarizes our findings and identifies facilitators and barriers with quotations from our participants by the CFIR domains and constructs and the types of stakeholders (Table 2).
Domain 1: Intervention characteristics
Within the intervention characteristics domain, the codes identified were relative advantage, adaptability, and complexity. The following are themes as barrier or facilitator to implementation efforts:
Barrier: Perceived burden and provider fatigue with EHR provider reminders
The EHR provider reminder generated alerts when the provider opened the patient’s medical record during visits. Providers needed to respond to the alert by updating the patient’s CRC screening history or ordering a screening test before advancing to the other medical record parts. Although the EHR provider reminder was considered simple and straightforward, some providers grew frustrated and started ignoring the alert knowingly or found ways to bypass them.
Barrier: EHR provider reminders were not up to date and became unreliable and ineffectual
When patients screen for CRC using the stool-based fecal immunochemical test, lab technicians upload the test results directly to the EHR. However, when patients screen for CRC using colonoscopy, they receive a referral to see an outside provider and complete the colonoscopy at another facility. Most of the time, the colonoscopy results are faxed to the clinic and manually entered into the EHR. Thus, EHR provider reminders might not be accurate or up to date and could create frustration.
Facilitator: Quarterly provider assessment and feedback reports provided real-time data that motivate changes
Although EHR collects a large amount of detailed patient health information, raw EHR data is disorganized and full of uncodified variables. The quarterly provider assessment and feedback intervention organized raw data from the EHR and provided performance evaluation reports at the provider and clinic levels. Providers could compare their performance with other providers at their clinic, and the clinic could compare its performance with other clinics within the FQHC. The quarterly provider assessment and feedback motivated the desire for changes.
Facilitator: The implementation of EBIs integrated with workflow processes
The implementation of the EBIs was considered straightforward and integrated into the clinic workflow without significant interruption. The leadership and implementation champions’ support and oversight made the adaptation process run smoothly with less resistance.
Domain 2: Outer setting
Within the outer setting domain, the codes identified were the needs and resources of those served by the organization, peer pressure, and external policy and incentives. The following are themes as barrier or facilitator to implementation efforts:
Barrier: Challenges to providing health care services to diverse patient populations
With 82% of patients from racial/ethnic minority groups and 32% of patients speaking a language other than English, it is challenging to provide culturally and linguistically competent care, let alone provide education in CRC screening and persuade them to comply with screening recommendations.
Barrier: Lack of awareness about CRC screening among patients
Over the years, efforts to promote breast cancer and cervical cancer screening achieved widespread attention, with the national breast cancer screening rate at 78% in 2016 and cervical cancer screening rate at 81% in 2018 [40, 41]. However, the organized efforts to promote CRC screening nationally have just started during the last decade. Furthermore, widespread media promotion might not reach minority communities, especially in communities where members are best served with a language other than English.
Facilitator: Pressure from funding requirement to report quality measures annually by the Health Resources & Services Administration (HRSA)
All FQHCs must submit data that reflect activities in the HRSA-approved health center project. Furthermore, each year health center grantees must report on their performance using quality measures defined in the Uniform Data System (UDS), such as CRC screening rate. The UDS is a standardized reporting system that provides consistent information about health centers and is open to public access.
Facilitator: Peer pressure to achieve high performance
UDS currently assigns quartile (1 to 4) to each quality measure. Clinical performance for each quality measure is ranked from quartile 1 (highest 25% of reporting health centers) to quartile 4 (lowest 25% of reporting health centers). Furthermore, in recent years, HRSA has begun providing different Quality Improvement Awards to promote the overall quality, efficiency, and value of the nation’s health centers’ healthcare services. These awards recognize the highest performing health centers and those health centers which have made significant improvements and gains from the previous year. The pressure from competing with other health centers motivates changes and creates an openness to improve the quality of care.
Domain 3: Inner setting
Within the inner setting domain, the codes identified were implementation climate, readiness for implementation, culture, and network and communication. For the implementation climate, we also identified three sub-codes: tension for change, organizational incentive and rewards, and goals and feedback. Also, there were three sub-codes for readiness for implementation as well. They were leadership engagement, available resources, and access to knowledge and information. The following are themes as barrier or facilitator to implementation efforts:
Barrier: Absence of CRC screening goals
The target goal for CRC screening rate was not clearly stated, neither at the organizational level nor at the clinic level, which might have hindered the commitment for improvement.
Barrier: Poor communication on goals and performance
The frontline implementers, such as providers and CRC stewards (integrated care specialists), did not know the organizational goal for the CRC screening rate. The quarterly provider assessment and feedback reports were not communicated directly with CRC stewards (integrated care specialists). They only learned about the performance of their efforts from their supervisors when the numbers were low and had no knowledge about the targeted number.
Barrier: Absence of print materials for frontline implementers to educate patients
In addition to the patients’ unfamiliarity with CRC screenings, 82% of patients were from racial/ethnic minority groups, and 32% spoke a language other than English. Providers and CRC stewards (integrated care specialists) needed print materials covering various CRC screening-related topics in multiple languages, not just information about CRC and different types of screening methods.
Facilitator: A culture of teamwork and a patient-centered mentality
The FQHC had a strong organizational culture of teamwork. A team approach is necessary to increase CRC screening since CRC is not a discrete event and involves multiple interfaces with health professionals. Because of the patient-centered mentality, there was a sense of commitment to get patients screened for CRC.
This qualitative study aimed to identify barriers and facilitators to implement three EBIs through stakeholders’ experience in an urban FQHC, determine which areas can be improved, and ultimately provide recommendations for a new project, ACCSIS-Chicago. We identified seven themes under barriers and five themes under facilitators. We identified two facilitators (adaptability and relative advantage) and two design quality and packaging barriers under the intervention characteristics. Our interviewees gave us detailed accounts of how the EBIs fit into their workflow and how the frequent assessment and feedback reports motivated them to change their ordering behaviors and improve CRC screening rates at their clinic. The two barriers we identified were related to the design and packaging of the EHR provider reminder. The provider reminder was a new feature added to the EHR system, and some providers found it frustrating when they could not advance to other features without addressing the prompt. Some providers identified workaround to bypass the prompt; however, such force flexibility may promote burnout , which some providers called “prompt fatigue.” Our findings on the importance of various aspects of the EBIs are consistent with studies that have examined how intervention characteristics influence implementation [12, 43, 44].
Prior research has reported how outer setting characteristics, such as patient needs , external policies , and inter-organization competitive pressure,  can influence implementation success. We found that competing with other FQHCs and the reporting requirement from HRSA could facilitate the implementation of EBIs, while a high level of patient needs could hinder the adoption process. Our findings highlight the need for implementing strategies that consider the complexities of the patient population. Within the inner setting, ongoing staff communication has been found to increase the likelihood of EBI sustainability over time . Also, appropriate feedback can benefit EBI implementation and has been associated with higher implementation success [49, 50]. In fact, our study found that poor communication and lack of feedback between leadership and staff could hinder the implementation process, highlighting the benefit of establishing feedback and communication mechanisms. Another notable finding from our study was that a strong culture of teamwork facilitated the implementation process. Studies found that teamwork provides the capacity to solve problems together during EBI uptake [51,52,53].
The ultimate goal of this study was to identify possible implementation strategies for a new project that can mplement the same EBIs to promote CRC screening in FQHC settings. Table 3 summarizes the actionable areas based on barriers identified and proposed strategies (Table 3).
Proposed implementation strategy for EHR provider reminder
We will tackle the two barriers related to the EHR provider reminder intervention using a teamwork-based approach to reduce the burden of responsibility. The proposed strategies will enhance, not replace, the EHR provider reminder intervention.
Strategy 1: Conduct morning huddles
“Huddles” are a structured daily health care team communication process done face-to-face for a brief duration (e.g., 5 to 10 min) and involves a team’s full membership. Huddles provide opportunities for team members to communicate and collectively strategize about managing daily patient demands and workflow, address patients’ unique needs and preferences, and improve the provision of preventive services through previsit planning [54, 55]. The Agency for Healthcare Research and Quality (AHRQ) recommends that healthcare teams huddle every morning for at least 10 min . At FQHCs, huddles can be done in the morning before the clinic begins. During the morning huddle, providers will get updates on patients’ CRC screening status and any perceived barriers from the medical assistant. Making the shift from provider-centric to team-based care can lessen the burden and frustration caused by the EHR provider reminder alone.
Strategy 2: Implement standing order for CRC
One strategy to reduce missed opportunities is standing orders. The CDC has recommended standing orders for adult vaccination since 2000 . Standing orders enable nurses and other staff to carry out a medical order according to a practice-approval protocol without a provider’s examination or requirement for approval. Standing orders might empower medical assistants to identify patients who are due for CRC screening and provide them with a home testing kit during a medical visit. Standing orders can free providers to address other health priorities. For standing orders to work, teamwork is essential .
Strategy 3: Use medical assistants to check, confirm, and update patient screening status during patient intake
Medical assistants can check and confirm the patient’s screening status before the patient visits or during the patient intake, and update the patient’s medical record. They can also follow-up colonoscopy reports and update patients’ medical records accordingly.
Proposed implementation strategy for provider assessment and feedback
Strategy 1: Set realistic goals for CRC screening rate at the organizational and clinic levels
Goals direct attention and action . In organizations, goals give direction to employees about what needs to be done. Specific and challenging goals can lead to better task performance and higher effort, mobilize energy, and increase persistence [60,61,62]. We will work with leadership to develop specific, realistic, and challenging goals to increase the CRC screening rate at the organizational and clinic levels from the baseline data.
Strategy 2: Provide assessment and feedback reports with targeted goals and disseminate them to all staff members
Specific, challenging goals, in conjunction with appropriate feedback, contribute to higher and better task performance . Feedback not only help individuals determine their level of performance, but also determines the adjustments needed to improve. We will include the target organizational and clinic goals for CRC screening rates in our quarterly provider assessment and feedback reports to serve as a performance benchmark and disseminate the report to all staff members.
Strategy 3: Provide technical support and financial assistance to create a quality data dashboard within the EHR
One of the strongest facilitators identified during the interviews was the importance of quarterly provider assessment and feedback reports on motivating behavior changes. Although many FQHCs have EHRs, most do not have the capacity to implement EHR generated feedback for clinicians because of the lack of resources and technical support. Although during the study period, the research team provided organized data and feedback, long-term sustainability was lacking. Since measuring and reporting outcome data are essential for health care systems to identify opportunities for improvement ; in our new project ACCSIS-Chicago, we will build a more sustainable platform for assessment. Specifically, we will provide technical support and financial assistance for our FQHC partners to create a clinical dashboard that links to their EHR and generates real-time assessment and feedback for their providers, which has been shown to impact the quality of care positively .
Proposed strategy to meet education material needs for diverse patient populations
Health education has always been a vital component of patient-centered care. With the influx of diverse patient populations (e.g., limited English proficiency) into the health care system, the lack of time for patient education during routine visits, the dearth of non-English educational materials, and the high rates of poor health literacy all make the provision of this vital service more challenging to accomplish. For the ACCSIS-Chicago project, the study team will conduct an online search to locate all available CRC and CRC screening-related educational materials, including materials in different languages, and screen the education materials for accuracy and health literacy level. We will also work with frontline implementers to identify education material needs other than the basic information on CRC, such as patient decision aids and a graphic FIT test instruction card that does not require English reading skills. Furthermore, we will develop a CRC patient education resource guide with the patient education materials we developed and found online.
Strengths and limitations
Our study demonstrates the feasibility of using the CFIR to identify facilitators and barriers across different interventions and capture the dynamics of the implementation context while using familiar implementation science terminology to promote greater transferability of findings. This study also provides the necessary evidence for using the CFIR to conduct a formative evaluation to inform future implementation processes. Furthermore, double-coding transcripts provided a rigorous and consistent application of the CFIR codes. However, the use of template analysis and the application of the CFIR domains and constructs as a coding template might have restricted the identification of non-CFIR-related themes critical to the implementation. Also, interviewees’ recall bias may limit findings since implementing the three EBIs began 2 years prior. Our results represent the experiences of one urban FQHC; therefore, themes identified here may not be transferable to other FQHCs, especially FQHCs operating in rural settings.
The CFIR comprises five domains and 39 constructs and provides a pragmatic structure to guide formative evaluations and build the implementation knowledge base. Researchers can use the CFIR before, during, and after implementation to identify potential barriers and facilitators from individuals involved in the implementation process. In this study, we conducted a post-implementation formative evaluation using the CFIR to explore what factors influenced the implementation of three EBIs in an urban FQHC. The CFIR, with its clear terminology, allowed us to identify barriers and facilitators to inform future research and provided a template to organize research data and synthesize findings, as demonstrated in this study. Thus, the CFIR has the potential to promote knowledge-building for implementation.
In this study, we identified seven barriers that might hinder the implementation and effectiveness of our EBIs. Our findings were consistent with constructs illustrated in CFIR, supporting its use as a guiding framework. These barriers are common in safety-net settings, such as FQHCs, where daily challenges include diverse patient populations, lack of resources, and competing demands. Provider recommendation is a significant predictor for patient adherence with CRC screening [64,65,66]. However, the workload and competing demands for providers in FQHCs make provider-centric interventions less effective. A teamwork-based approach using huddles and standing orders to share the burden can overcome some of the barriers facing providers and ensure their engagement and participation during the implementation. Facilitators that are unique for FQHCs, including the requirement from HRSA to submit quality measures, the incentive for improvement, and the providers’ commitment to their patients, all can promote changes and openness to new ways of practice. Together, these drivers of change can mitigate resistance and accelerate the implementation process, ultimately increasing the adoption of EBIs and reducing disparities.
Availability of data and materials
Federally qualified health center
Accelerating Colorectal Cancer Screening and Follow-up through Implementation Science-Chicago
Consolidated Framework for Implementation Research
Electronic Health Record
Wilson PM, Petticrew M, Calnan MW, Nazareth I. Disseminating research findings: what should researchers do? A systematic scoping review of conceptual frameworks. Implement Sci. 2010;5:91.
Grimshaw JM, Eccles MP, Lavis JN, Hill SJ, Squires JE. Knowledge translation of research findings. Implement Sci. 2012;7(1):50. https://doi.org/10.1186/1748-5908-7-50.
Bares DW, Singh H. Two decades since to Err is human: an assessment of progress and emerging priorities in patient safety. Health Aff. 2018;37:1736–43.
Fixsen DL, Blask K. Implementation: the missing link between research and practice. NINR Implementation Brief, 1. Chapel Hill: The University of North Carolina; 2019. https://files.eric.ed.gov/fulltext/ED507422.pdf Accessed 15 Sept 2020
Greenhalgh T, Robert G, MacFarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004;82(4):581–629. https://doi.org/10.1111/j.0887-378X.2004.00325.x.
Shortell SM. Increasing value: a research agenda for addressing the managerial and organizational challenges facing health care delivery in the United States. Med Care Res Rev. 2004;61:125–305.
Keith RE, Crossan JC, O’Malley AS, Cromp D, Taylor EF. Using the Consolidated Framework for Implementation Research (CFIR) to produce actionable findings: a rapid-cycle evaluation approach to improve implementation. Implement Sci. 2017;12(1):15. https://doi.org/10.1186/s13012-017-0550-7.
Proctor EK, Powell BJ, McMillen JC. Implementation strategies: recommendations for specifying and reporting. Implement Sci. 2013;8(1):139. https://doi.org/10.1186/1748-5908-8-139.
Alexander JA, Herald LR. Methods and metrics challenges of delivery-system research. Implement Sci. 2012;7(1):15. https://doi.org/10.1186/1748-5908-7-15.
Glasgow RE, Chambers D. Developing robust, sustainable, implementation systems using rigorous, rapid and relevant science. Clin Transl Sci. 2012;5(1):48–55. https://doi.org/10.1111/j.1752-8062.2011.00383.x.
Tomoaia-Cotisel A, Scammon DL, Waitzman NJ, Cronholm PF, Halladay JR, Driscoll DL, et al. Context matters: the experience of 14 research teams in systematically reporting contextual factors important for practice change. Ann Fam Med. 2014;11(S1):S115–23.
Tabak RG, Khoong EC, Chambers DA, Brownson RC. Bridging research and practice: models for dissemination and implementation research. Am J Prev Med. 2012;43(3):337–50. https://doi.org/10.1016/j.amepre.2012.05.024.
Nilsen P. Making sense of implementation theories, models, and frameworks. Implement Sci. 2015;10(1):53. https://doi.org/10.1186/s13012-015-0242-0.
Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4(1):50. https://doi.org/10.1186/1748-5908-4-50.
Sabatino SA, Lawrence B, Elder R, Mercer SL, Wilson KM, DeVinney B, et al. Effectiveness of interventions to increase screening for breast, cervical, and colorectal cancers: nine updated systematic reviews for the Guide to Community Preventive Services. Am J Prev Med. 2012;43(1):97–118. https://doi.org/10.1016/j.amepre.2012.04.009.
Sabatino SA, Habarta N, Baron RC, Coates RJ, Rimer BK, Kerner J, et al. Interventions to increase recommendation and delivery of screening for breast, cervical, and colorectal cancers by healthcare providers systematic reviews of provider assessment and feedback and provider incentives. Am J Prev Med. 2008;35(1):S67–74. https://doi.org/10.1016/j.amepre.2008.04.008.
Chen LA, Santos S, Jandorf L, Christie J, Castillo A, Winkel G, et al. A program to enhance completion of screening colonoscopy among urban minorities. Clin Gastroenterol Hepatol. 2008;6(4):443–50. https://doi.org/10.1016/j.cgh.2007.12.009.
Christie J, Itzkowitz S, Lihau-Nkanza I, Castillo A, Redd W, Jandorf L. A randomized controlled trial using patient navigation to increase colonoscopy screening among low-income minorities. J Natl Med Assoc. 2008;100(3):278–84. https://doi.org/10.1016/S0027-9684(15)31240-2.
Jandorf L, Gutierrez Y, Christie J, Itzowitz SH. Use of a patient navigator to increase colorectal cancer screening in an urban neighborhood health clinic. J Urban Health. 2005;82(2):216–24. https://doi.org/10.1093/jurban/jti046.
Lasser KE, Murillo J, Medlin E, Lisboa S, Valley-Shah L, Fletcher RH, et al. A multilevel intervention to promote colorectal cancer screening among community health center patients: results of a pilot study. BMC Fam Pract. 2009;10(1):37. https://doi.org/10.1186/1471-2296-10-37.
Ma GX, Shive S, Tan Y, Gao W, Rhee J, Park M, et al. Community-based colorectal cancer intervention in underserved Korean Americans. Cancer Epidemiol Biomark Prev. 2009;33(5):381–6. https://doi.org/10.1016/j.canep.2009.10.001.
Myers RE, Hyslop T, Sifri R, Bittner-Fagan H, Katurakes NC, Cocroft J, et al. Tailored navigation in colorectal cancer screening. Med Care. 2008;46(9):S123–31. https://doi.org/10.1097/MLR.0b013e31817fdf46.
Nash D, Azeez S, Vlahov D, Schori M. Evaluation of an intervention to increase screening colonoscopy in an urban public hospital setting. J Urban Health. 2006;83(2):231–43. https://doi.org/10.1007/s11524-006-9029-6.
Percac-Lima S, Grant RW, Green A, Ashbumer J, Gamba G, et al. A patient-tailored navigator program for colorectal cancer screening in a community health center: a randomized controlled trial. J Gen Intern Med. 2008;23:237–8.
Percac-Lima S, Grant RW, Green A, Ashbumer J, Gamba G, et al. A culturally tailored navigator program for colorectal cancer screening in a community health center: a randomized controlled trial. J Gen Intern Med. 2009;24(2):211–7. https://doi.org/10.1007/s11606-008-0864-x.
Steinwachs D, Allen JD, Barlow WE, Duncan RP, Egede LE, Friedman LS, et al. NIH state-of-science conference statement: enhancing use and quality of colorectal cancer screening. NIH Consens State Sci Statements. 2010;27(1):1–31.
Damschroder LJ, Lowery JC. Evaluation of a large-scale weight management program using the Consolidated Framework for Implementation Research (CFIR). Implement Sci. 2013;8(1):51. https://doi.org/10.1186/1748-5908-8-51.
Gould NJ, Lorencatto F, Stanworth SJ, Michie S, Prior ME, Glidewell L, et al. Application of theory to enhance audit and feedback interventions to increase the uptake of evidence-based transfusion practice: an intervention development protocol. Implement Sci. 2014;9(1):92. https://doi.org/10.1186/s13012-014-0092-1.
Forman J, Harrod M, Robinson C, Annis-Emeott A, Ott J, Saffar D, et al. First things first: foundation requirements for a medical home in an academic medical center. J Gen Intern Med. 2014;9:9.
Luck J, Bowman C, York L, Midboe A, Taylor T, Gale R, et al. Multimethod evaluation of the VA’s peer-to-peer toolkit for patient-centered medical home implementation. J Gen Intern Med. 2014;29(Suppl 2):S572–8.
Richardson JE, Abramson EL, Pfoh ER, Kaushal R. Bridging informatics and implementation science: evaluating a framework to assess electronic health record implementations in community settings. AMIA Ann Symp Proc. 2012;2012:770–8.
Ramsey A, Lord S, Torrey J, Marsch L, Lardiere M. Paving the way to successful implementation: identifying key barriers to use of technology-based therapeutic tools for behavioral health care. J Behav Health Serv Res. 2016;43(1):54–70. https://doi.org/10.1007/s11414-014-9436-5.
Kalkan A, Roback K, Hallert E, Carlsson P. Factors influencing rheumatologists inverted question mark prescription of biological treatment in rheumatoid arthritis: an interview study. Implement Sci. 2014;9(1):153. https://doi.org/10.1186/s13012-014-0153-5.
Robins LS, Jackson JE, Green BB, Korngiebel D, Force RW, Baldwin LM. Barriers and facilitators to evidence-based blood pressure control in community practice. J Am Board Fam Med. 2013;26(5):539–57. https://doi.org/10.3122/jabfm.2013.05.130060.
Sanchez V, Steckler A, Nitirat P, Hallfors D, Cho H, Brodish P. Fidelity of implementation in a treatment effectiveness trial of reconnecting youth. Health Educ Res. 2007;22(1):95–107. https://doi.org/10.1093/her/cyl052.
Prior M, Elouafkaoui P, Elders A, Young L, Duncan EM, Newlands R, et al. Evaluating an audit and feedback intervention for reducing antibiotic prescribing behavior in general dental practice (the RAPID trial): a partial factorial cluster randomized trial protocol. Implement Sci. 2014;9(1):50. https://doi.org/10.1186/1748-5908-9-50.
Sherr K, Gimbel S, Rustagi A, Nduati R, Cuembelo F, Farquhar C, et al. Systems analysis and improvement to optimize pMTCT (SAIA): a cluster randomized trial. Implement Sci. 2014;9:55.
CFIR Research Team-Center for Clinical Management Research. Qualitative data collection: interview guide tool. Ann Arbor: CFIR Research Team-Center for Clinical Management Research. https://cfirguide.org/evaluation-design/qualitative-data/ Accessed 15 Sept 2020
Brooks J, McCluskey S, Turley E, King N. The utility of template analysis in qualitative psychology research. Qual Res Psychol. 2015;12(2):202–22. https://doi.org/10.1080/14780887.2014.955224.
American Cancer Society. Breast cancer facts and figures: 2019-2020. 2019 https://www.cancer.org/content/dam/cancer-org/research/cancer-facts-and-statistics/breast-cancer-facts-and-figures/breast-cancer-facts-and-figures-2019-2020.pdf Accessed 16 Sept 2020
National Cancer Institute. Trend progression report: cervical cancer screening. 2020 https://progressreport.cancer.gov/detection/cervical_cancer Access 16 Sept 2020.
Bickell NA, Moss AD, Castaldi M, Shah A, Sickles A, Pappas P, et al. Organizational factors affect safety-net hospitals’ breast cancer treatment rates. Health Serv Res. 2017;52:137–55.
Ilott I, Gerrish K, Booth A, Field B. Testing the consolidated framework for implementation research on health care innovations from South Yorkshire. J Eval Clin Pract. 2013;15:993–1000.
Liang S, Kegler MC, Cotter M, Emily P, Beasley D, Hermstad A, et al. Integrating evidence-based practices for increasing cancer screenings in safety net health systems: a multiple case study using the Consolidated Framework for Implementation Research. Implement Sci. 2016;11:109.
Costa DK, White MR, Ginier E, Manojlovich M, Govindan S, Iwashyna TJ, et al. Identifying barriers to delivering the awakening and breathing coordination, delirium, and early exercise/mobility bundle to minimize adverse outcomes for mechanically ventilated patients: a systematic review. Chest. 2017;152(2):304–11. https://doi.org/10.1016/j.chest.2017.03.054.
Hinde J, Bray J, Kaiser D, Mallonee E. The influence of state-level policy environments on the activation of the Medicaid SBIRT reimbursement codes. Addiction. 2017;112(S2):82–91. https://doi.org/10.1111/add.13655.
Walston SL, Kimberly JR, Burns LR. Institutional and economic influences on the adoption and extensiveness of managerial innovation in hospitals: the case of reengineering. Med Care Res Rev. 2001;58(2):194–228. https://doi.org/10.1177/107755870105800203.
Chuang E, Jason K, Morgan JC. Implementing complex innovations: factors influencing middle manager support. Health Care Manag Rev. 2011;36(4):369–79. https://doi.org/10.1097/HMR.0b013e3182100cc2.
Green SA, Bell D, Mays N. Identification of factors support successful implementation of care bundles in the acute medical setting: a qualitative study. BMC Health Serv Res. 2017;17(1):120. https://doi.org/10.1186/s12913-017-2070-1.
Krein SL, Damschroder LJ, Kowalski CP, Forman J, Hofer TP, Saint S. The influence of organizational context on quality improvement and patient safety efforts in infection prevention: a multi-center qualitative study. Soc Sci Med. 2010;71:692–701.
Bergstrȍm A, Peterson S, Namusoko S, Waiswa P, Wallin L. Knowledge translation in Uganda: a qualitative study of Uganda midwives’ and managers; perceived relevance of the sub-elements of the context cornerstone in the PARIHSframework. Implement Sci. 2012;7(1):117. https://doi.org/10.1186/1748-5908-7-117.
McCullough MB, Chou AF, Solomon JL, Petrakis BA, Kim B, Parl AM, et al. The interplay of contextual elements in implementation: an ethnographic case study. BMC Health Serv Res. 2015;15(1):62. https://doi.org/10.1186/s12913-015-0713-7.
Li SA, Jeffs L, Barwick M, Stevens B. Organizational contextual features that influence the implementation of evidence-based practices across healthcare settings: a systemic integrative review. BMC Syst Rev. 2018;7(1):72. https://doi.org/10.1186/s13643-018-0734-5.
Goldenhar LM, Brady PW, Sutcliffe KM, Muething SE. Huddling for high reliability and situation awareness. BMJ Qual Saf. 2013;22(11):899–906. https://doi.org/10.1136/bmjqs-2012-001467.
Picciano A, Winter RO. Benefits of huddle implementation in the family medicine center. Fam Med. 2013;45(7):501–4.
Agency for Healthcare Research and Quality. TeamSTEPPS 2.0. 2020 https://www.ahrq.gov/teamstepps/index.html Accessed 16 Sept 2020
McKibben LJ, Stange PV, Sneller VP, Srikas RA, Rodewald LE. Use of standing orders programs to increase adult vaccination rates: recommendations of the Advisory Committee on Immunization Practices. MMWR. 2000;49(RR-1):21–6.
Albert SM, Nowalk MP, Yonas MA, Zimmerman RK, Ahmed F. Standing orders for influenza and pneumococcal polysaccharide vaccination: correlates identified in a national survey of U.S. primary care physicians. BMC Fam Pract. 2012;13:22.
Locke EA. Purpose without consciousness: a contradiction. Psychol Rep. 1969;25(3):991–1009. https://doi.org/10.2466/pr0.1922.214.171.1241.
Locke EA, Shaw KN, Saari LM, Latham GP. Goal setting and task performance: 1969–1980. Psychol Bull. 1981;90(1):125–52. https://doi.org/10.1037/0033-2909.90.1.125.
Mento AJ, Steel RP, Karren RJ. A meta-analytic study of the effects of goal setting on task performance. Organ Behav Hum Decis Process. 1987;39(1):52–83. https://doi.org/10.1016/0749-5978(87)90045-8.
Lunenburg FC. Goal-setting theory of motivation. Int J Manage Bus Adm. 2011;5:1.
Dowding D, Randell R, Gardner P, Fitzpatrick G, Dykes P, Favela F, et al. Dashboards for improving patient care: review of the literature. Int J Med Inform. 2015;84(2):87–100. https://doi.org/10.1016/j.ijmedinf.2014.10.001.
Laiyemo AO, Adebogun AO, Doubeni CA, Ricks-Santi L, McDonald-Pinekeet S, Young PE, et al. Influence of provider discussion and specific recommendation on colorectal cancer screening uptake among U.S. adults. Prev Med. 2014;67:1–5. https://doi.org/10.1016/j.ypmed.2014.06.022.
Dolan NC, Ramirez-Zohfled V, Rademaker A, Ferreira MR, Galantar W, Radosta J, et al. The effectiveness of physician-only and physician-patient intervention on colorectal cancer screening discussion between providers and African American and Latino patients. J Gen Intern Med. 2015;30(12):1780–7. https://doi.org/10.1007/s11606-015-3381-8.
Winawer SJ. A quarter century of colorectal cancer screening: progress and prospect. J Clin Oncol. 2001;19(18 Suppl):6S–12S.
We would like to thank our federally qualified health center partner and their providers, administrators, and staff members who volunteered their time for participation in this study.
This work is supported through the National Cancer Institute Moonshot Initiative Accelerating Colorectal Cancer Screening and Follow-up through Implementation Science (UG3CA233229) and the Centers for Disease Control and Prevention Colorectal Cancer Control Program (5NU58DP006079-05-0).
Ethics approval and consent to participate
The protocol for the study and the participant consent form has been reviewed and approved by the University of Chicago Institutional Review Board (IRB18-1141).
Consent for publication
The authors declare that they have no competing interests
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Lam, H., Quinn, M., Cipriano-Steffens, T. et al. Identifying actionable strategies: using Consolidated Framework for Implementation Research (CFIR)-informed interviews to evaluate the implementation of a multilevel intervention to improve colorectal cancer screening. Implement Sci Commun 2, 57 (2021). https://doi.org/10.1186/s43058-021-00150-9
- Federally Qualified Health Center
- Colorectal cancer screening
- Evidence-based intervention
- Consolidated Framework for Implementation Research
- Implementation strategy