Skip to main content
Download PDF
Download ePub
  • Study protocol
  • Open access
  • Published:

Methods for scaling up an outreach intervention to increase colorectal cancer screening rates in rural areas

Implementation Science Communications volume 5, Article number: 6 (2024) Cite this article

A Correction to this article was published on 24 January 2024

This article has been updated

Abstract

Background

Mailed fecal immunochemical test (FIT) outreach and patient navigation are evidence-based practices shown to improve rates of colorectal cancer (CRC) and follow-up in various settings, yet these programs have not been broadly adopted by health systems and organizations that serve diverse populations. Reasons for low adoption rates are multifactorial, and little research explores approaches for scaling up a complex, multi-level CRC screening outreach intervention to advance equity in rural settings.

Methods

SMARTER CRC, a National Cancer Institute Cancer Moonshot project, is a cluster-randomized controlled trial of a mailed FIT and patient navigation program involving 3 Medicaid health plans and 28 rural primary care practices in Oregon and Idaho followed by a national scale-up trial. The SMARTER CRC intervention combines mailed FIT outreach supported by clinics, health plans, and vendors and patient navigation for colonoscopy following an abnormal FIT result. We applied the framework from Perez and colleagues to identify the intervention’s components (including functions and forms) and scale-up dissemination strategies and worked with a national advisory board to support scale-up to additional organizations. The team is recruiting health plans, primary care clinics, and regional and national organizations in the USA that serve a rural population. To teach organizations about the intervention, activities include Extension for Community Healthcare Outcomes (ECHO) tele-mentoring learning collaboratives, a facilitation guide and other materials, a patient navigation workshop, webinars, and individualized technical assistance. Our primary outcome is program adoption (by component), measured 6 months after participation in an ECHO learning collaborative. We also assess engagement and adaptations (implemented and desired) to learn how the multicomponent intervention might be modified to best support broad scale-up.

Discussion

Findings may inform approaches for adapting and scaling evidence-based approaches to promote CRC screening participation in underserved populations and settings.

Trial registration

Registered at ClinicalTrials.gov (NCT04890054) and at the NCI’s Clinical Trials Reporting Program (CTRP no.: NCI-2021–01032) on May 11, 2021.

Background

Colorectal cancer (CRC) is the third largest cause of cancer deaths in the USA despite the availability of highly effective screening that can reduce mortality and morbidity [1,2,3]. Mailed fecal immunochemical test (FIT) outreach and patient navigation are evidence-based practices shown to improve rates of CRC screening in various settings. Multiple systematic reviews and meta-analysis of mailed FIT outreach have reported average improvements in CRC screening of 22–28 percentage points [4,5,6,7,8]; this approach also reduced disparities in CRC outcomes between Black and non-Hispanic White populations in a large integrated system [9]. Patient navigation, in which a trained individual assesses patient barriers and delivers tailored educational and emotional support, can further address barriers to screening [7, 10,11,12]. A recent meta-analysis of patient navigation programs for CRC screening showed a 64% relative improvement over usual care [13]. Nevertheless, neither mailed FIT outreach nor patient navigation have been broadly adopted by health systems and organizations that serve rural and Medicaid populations.

The reasons for low adoption are multi-factorial. Some health systems have limited information technology resources or infrastructure to identify patients who are eligible for CRC screening and track key outcomes [14, 15]. Limited electronic health record (EHR) data can cause difficulties in identifying and targeting patient populations for interventions [16,17,18]. Another key barrier in many under-resourced health systems is a lack of adequate staffing. High staff or leadership turnover can lead to restructuring the organization and many additional hours for training new staff [16, 19, 20]. Another common barrier is the time required for staff to implement a centralized outreach program, particularly using patient navigation as part of it [21,22,23]. For a program like the centralized mailed FIT program described above, organizations relied on existing staff with various roles to implement the program components, causing extra time burden with other competing work priorities [16, 24]. Furthermore, while ultimately cost-effective [25, 26], patient navigation and mailed FIT require initial financial investments and can thus be perceived as costly and unsustainable in resource-limited settings [21, 22]. Budget impacts range from US $25.50 more per patient for FIT completion navigation compared to usual care [27] to US $275 or more per patient for navigation through completion of all screening [25]. For complex, multi-level interventions such as these, approaches are needed to introduce both the scientific evidence and implementation strategies to organizations in a way that encourages adoption.

A pragmatic trial tested the implementation, effectiveness, and maintenance of a mailed FIT test and patient navigation program to improve rates of CRC screening and follow-up in clinical practices serving rural Medicaid enrollees [10]. While spreading an evidence-based practice such as this one involves replicating that practice in additional similar organizations, we want to examine ways to “scale up” a multi-level intervention to different types of organizations and addressing system issues that arise during full-scale implementation [28,29,30]. Here, we describe the protocol for a scale-up study that is rolling out a mailed FIT and patient navigation intervention to rural organizations and studying effective approaches for scaling up a complex, multi-level intervention. We describe how we identified the intervention’s core functions [31] and present the design for the evaluation of scale-up activities.

Methods

This paper describes the scale-up protocol of the SMARTER CRC project, a two-phase study that includes a pragmatic trial followed by a scale-up trial. SMARTER CRC is being conducted as part of the National Cancer Institute-funded Accelerating Colorectal Cancer Screening and Follow-up through Implementation Science (ACCSIS) consortium [32]. The overall aim of ACCSIS is to conduct multi-site, coordinated, transdisciplinary research to evaluate and improve CRC screening processes using implementation science strategies. The protocol for the main trial has been previously reported [10]. Briefly, the first phase of SMARTER CRC is a large-scale, cluster-randomized trial involving 3 health plans and 28 rural clinics serving populations with Medicaid insurance. The trial tests an intervention to improve rates of CRC screening using a collaborative model involving health plans, direct-mail vendors, and affiliated clinics to deliver mailed FIT outreach [33] and patient navigation for follow-up colonoscopy [34]. We refer to that here as the “SMARTER CRC intervention” and consider it to be a complex, multicomponent health intervention as defined by Perez Jolles and colleagues [31]. The mailed FIT outreach component relies on best practices identified during the CDC-sponsored mailed FIT summit [5], and the patient navigation component uses an adapted version of the phone-based New Hampshire Colorectal Cancer Screening Program [35]. Implementation was supported by training (i.e., 5-h multi-model patient navigation training; 1-h training on how to review patient lists) and practice facilitation delivered by members of the study team.

Both phases in SMARTER CRC involved a collaborative partnership between the Oregon Health & Science University’s (OHSU) Oregon Rural Practice-based Research Network and the Kaiser Permanente Northwest Center for Health Research. A regional advisory board of local practitioners, patient representatives, CRC, and public health experts met quarterly and informed the pragmatic trial; a national advisory board of CRC experts, rural health experts, patient organization representatives, and national public health experts meets quarterly and is informing the scale-up trial. SMARTER CRC has obtained approval from the OHSU’s Institutional Review Board (protocol number: 20681), which has granted a waiver of informed consent. A ceding agreement was obtained from the Kaiser Permanente Center for Health Research.

Tailoring implementation strategies for scale-up

The goals for phase 2 of the SMARTER CRC study is to refine the SMARTER CRC intervention for additional types of organizations and test it in the scale-up portion of the study which is as follows:

  • Partner with regional and national organizations (n ~ 20) to scale up the program to clinics serving rural and underserved patients in high-priority geographic regions of the US (n ~ 130 clinics; 17,000+ patients) using collaborative learning, workshops and webinars, and practice facilitation. Assess training delivered, program adoption and adaptations, and determinants of dissemination success.

Findings from the cluster-randomized trial were used to inform modifications to the SMARTER CRC intervention to prepare for scale-up [36,37,38]. Qualitative findings from analysis of clinic contact logs, interviews with clinics and health plans, and periodic reflections with practice facilitators were synthesized and made available to ECHO faculty to inform development of the ECHO didactic sessions. Findings pertained to strategies for designing CRC outreach programs (e.g., including providers in planning and mailing in batches for large populations), tailoring outreach to patient populations (e.g., developing culturally sensitive materials), identifying patients for FIT mailing (e.g., filtering out inactive patients), increasing patient uptake (e.g., using messages from providers), and reducing clinic-level implementation barriers (e.g., developing patient navigation guides). These strategies were identified based on actual or desired adaptations during the cluster-randomized study [39]. To inform scale-up planning, we used causal-loop diagramming, a method from systems science, to identify causal mechanisms underlying the SMARTER CRC multi-level intervention, as understood by the study team [40]. Second, using these qualitative research data, we also identified factors associated with implementation success [39].

Based on these findings and conversations with the national advisory board, we identified three objectives for our scale-up activities: (1) focus on CRC screening outreach for rural communities, (2) teach a diverse set of organizations multicomponent and multi-level approaches to raise CRC screening and follow-up rates, and (3) provide tools for organizational change and implementation strategies to support the outreach intervention.

Scale-up methods and strategy

In our pragmatic trial, the SMARTER CRC intervention leverages partnerships between clinics, health plans, vendors, and the study team to share the burden of implementation. Table 1 presents the intervention broken down into intervention components, or major categories of the SMARTER CRC intervention along with the determinants, which are contextual factors driving the need for each component. For each component, present the function or purpose of the activities, the form the activities take as modified from the initial pragmatic trial, and the scale-up dissemination approach to how those components are shared with recruited organizations [28, 31, 41].

Table 1 SMARTER CRC intervention functions, forms, and scale-up approach
Full size table

We worked with our national advisory board to develop a plan to scale up the program and disseminate training to a national audience. The first part of this work involved defining which functions of the intervention would be shared with new organizations. Then the scale-up plan was developed and included learning collaboratives informed by the Extension for Community Healthcare Outcomes (ECHO) project [42], virtual workshops and webinars, technical assistance, and a supporting facilitation guide. ECHO-informed learning collaboratives were chosen to facilitate participation by busy rural and remote healthcare organizations. Because ECHO supports case-based learning, we opted to supplement the ECHO learning collaboratives with workshops and webinars to build specific content-area expertise. In addition, the research team also used the Translational Science Roadmap to Impact to establish audience for recruitment, topics for dissemination, and components that were core elements of the implementation support [43].

Recruitment

Our study’s scale-up recruitment targets clinical practices and hospital systems, community organizations, health departments, health plans (national or regional), and tribal clinic systems. To better serve contexts likely to be encountered during scale-up, we have expanded the types of organizations from those enrolled in the pragmatic trial (i.e., Oregon Medicaid health plans and clinical practices) to a wider array of organizational types and explore how the intervention could flex to new environments. To be eligible for participation in the scale-up, organizations must have interest in improving rates of CRC screening and/or follow-up in the populations they serve and commit to attending the ECHO sessions and completing data collection activities. A list of potential participants for scale-up outreach was developed that includes organizations unable to take part in the initial pragmatic trial but interested in the topic, recommended contacts from advisory board members and their networks, settings with prior relationships with study team members, and ECHO series registration requests. Additional leads were gathered using a snowball sampling approach, warm-handoff referrals, or by partners contacting the research team directly after hearing regional or national presentations.

The study team (principal investigators, project managers, practice facilitators) works in partnership with local, regional, and national research partners to recruit representatives from these organizations. The study team developed recruitment materials, including an email template, a recruitment flyer, and a slide presentation which describe the scale-up program and include a link to register for the ECHO series. In addition, the Oregon ECHO Network—which hosts our ECHO scale-up activities—regularly publishes information about upcoming opportunities, including the CRC Outreach ECHO description. The team tracks outreach using an in-house clinic relationship management tool built in Microsoft Access; this tracking included reasons for participation or declining to participate.

Scale-up dissemination approach

To spread the SMARTER CRC program to the recruited organizations, we take a multipronged approach to sharing program components and materials. Implementation research has shown that dissemination of a toolkit alone is not sufficient to spark organizational change [44]. The scale-up dissemination activities include collaborative learning, a facilitation guide and other materials, individualized technical assistance, a patient navigation workshop, and webinars (Table 1).

Collaborative learning (ECHO)

ECHO is a collaborative learning program that uses tele-mentoring to support systems to improve health care quality. During ECHO sessions, healthcare providers and other participants use telecommunication technology to deliver and receive training, education, and support that build team capacity. A typical ECHO session consists of a 15-min expert presentation followed by a case study led by an attendee (such as a clinic staff or organizational representative). For SMARTER CRC, we designed a six-session ECHO series, with topics focused on the following: (1) building the business case for CRC outreach, (2) building engagement, (3) designing a mailed FIT program, (4) identifying patients who are due for CRC screening, (5) delivering patient communications (FIT and reminders), and (6) navigating to follow-up colonoscopy. The series is delivered twice between March and November 2023.

A facilitation guide and a set of local and national resources on mailed FIT and patient navigation, compiled by the research team, is provided to ECHO attendees. Following the ECHO series, participants are invited to attend a workshop on patient navigation, training webinars on multi-level communications and implementation challenges, and are eligible for organization-specific technical assistance in any of the topics covered during the ECHO series.

Patient navigation workshop

The multimodal patient navigation training program developed for the main trial is offered to ECHO attendees to support asynchronous and synchronous interactive learning. The 5-h workshop addresses the importance of CRC screening and follow-up, barriers to CRC screening, and the patient navigation protocol. An optional pre-recorded video on motivational interviewing is also available for attendees.

Training webinars

Participants in the ECHO and patient navigation workshop are invited to participate in 1-h webinars based on organizational need and desired skill development. The webinars build content-specific knowledge and share best practices. The topics of the webinars include workflow design, common implementation challenges, patient engagement, and tailoring outreach to underserved patient populations.

Technical assistance

Consistent with the pragmatic trial, scale-up practice facilitation activities are primarily facilitated by the project manager, practice facilitators, and other study team members with relevant expertise. During the ECHO series, participating organizations are offered a chance to sign up for a 1-h technical assistance session. These technical assistance meetings address the key goals and objectives identified by the participating organization, and team members provide expertise in the relevant area.

Data collection

Scale-up evaluation includes summative surveys, interviews following the ECHO, and formative satisfaction surveys following each session as described in detail below.

Baseline, post-ECHO, and 6-month follow-up surveys

At the launch of the ECHO learning collaboratives, workshops, and webinars, registered participants are asked to complete a brief (15-min) survey. Baseline survey questions assess current clinical practices related to CRC screening and follow-up (e.g., current CRC screening practices and policies, screening test use, and organizational resources). Additional questions are based on the Consolidated Framework for Implementation Research (CFIR) [45, 46] and relate to organizational readiness, internal context (leadership, staffing, resources, culture/teamwork, communication, organizational capacity), and external context (geography, policy). We use adapted questions from prior ECHO assessment tools to assess organizational learning processes, organizational knowledge creation, and training content. For all participants, we gather demographic information (e.g., age, sex), professional role, affiliated organization name and location, and email address. Participants of multiple SMARTER CRC training events are asked to complete a single baseline survey.

After the last ECHO session, another brief survey (20 min) is distributed to participants covering satisfaction with the ECHO, what they learned during the ECHO, clinical practices related to CRC screening, and intentions to adopt the program components. We use questions adapted from the Program Sustainability Assessment Tool (PSAT) [47] to assess organizational knowledge transfer, organizational knowledge retention, and workflow integration. Questions about capacity for sustainability, also adapted from the PSAT, include organizational support, funding stability, partnerships, and organizational capacity.

Six months following the administration of the baseline survey, study staff email respondents an invitation to complete a follow-up survey. This survey asks respondents about their clinical practices related to CRC screening and follow-up, the extent to which implementation of the SMARTER CRC program is being planned or executed, planned or implemented adaptations to the program, and their participation in SMARTER CRC trainings or workshops.

Satisfaction surveys

Brief satisfaction surveys are administered immediately following each ECHO learning collaborative session (six sessions delivered twice) and following each workshop or webinar. The satisfaction survey gathers participant demographics, role, and affiliation and asks about their overall satisfaction with the session, areas for improvement, and remaining questions they have.

Qualitative interviews

At least one member of each organization participating in the ECHO series is invited to take part in a semi-structured qualitative interview conducted about 3 months after completion of the last ECHO session. Interviews seek to understand contextual factors, barriers, and facilitators to implementation and sustainment, ECHO program acceptability, adaptations (both desired and executed), and unanticipated consequences (positive or negative). Interviews are conducted via videoconference and generally last 30–60 min. All qualitative interviews will be digitally recorded, professionally transcribed, uploaded to ATLAS.ti, and then analyzed by the research team using an immersion crystallization approach to identify salient themes [48].

Scale-up evaluation

The scale-up evaluation is focused on recruited organizations and has three objectives: (1) assess engagement in scale-up activities, (2) determine implementation of a mailed FIT test and patient navigation program as a result of engagement in scale-up activities, and (3) describe adaptations of core components of a CRC screening outreach program and the rationale for modifications (Table 2).

Table 2 Measures and data sources for SMARTER CRC scale-up
Full size table

Engagement

Engagement is defined as organizational behavior (as measured by participation) and affect (as measured by self-reported satisfaction) with scale-up activities [49]. We will compare engagement within and across recruited organizations to assess how scale-up strategies lead to adoption of any CRC screening components. Organizational engagement is measured through multiple data sources. We use attendance logs to track the number of individuals and organizational representatives who attend our ECHO sessions, patient navigation workshop, webinars, and individualized technical assistance sessions. Research staff observe training and collaborative learning sessions to qualitatively assess levels of engagement by organizations. We maintain study materials on the ECHO website and track downloads of facilitation guide and templates. We collect the number of individuals (by role) and organizations (by type) who participated in each collaborative learning, training, and technical assistance session. These data will be analyzed using quantitative and qualitative methods.

Adoption

Adoption measures the number, proportion, and representativeness a mailed FIT and patient navigation program components implemented by recruited organizations (per the RE-AIM framework). Using the post-ECHO survey and 6-month follow-up survey data, we assess the number of organizations that have facilitated the delivery of the SMARTER CRC intervention (i.e., worked with another organization to implement program components) and the number of health plans or clinics who have begun to implement each component of the intervention (i.e., mailed FIT and patient navigation) and characterize adoption similarities and differences across recruited organization. We assess degree of implementation and fidelity with which program components are implemented using the RE-AIM framework [50,51,52].

Adaptations

Using FRAME-IS (i.e., the Framework for Reporting Adaptations and Modifications to Evidence-based Implementation Strategies), adaptations are defined as modifications made to a mailed FIT and patient navigation program components and an organization’s rationale for these changes [53]. Among organizations who have implemented a mailed FIT or patient navigation program, we collect and report information about adaptations to the program and reasons adaptations were made. We use data from 6-month follow-up surveys, key informant interviews, and meeting notes from technical assistance sessions to track adaptations to the program and implementation support. We classify adaptations using components of the FRAME (Framework for Reporting Adaptations and Modifications-Enhanced) for intervention adaptations and the FRAME-IS framework for implementation strategy adaptations [54, 55], focusing on adaptation goal, type, and the reason the adaptation was made. We build on prior application of the FRAME framework by our team to track factors such as who decided to make an adaptation and whether it was made proactively or reactively in response to an identified need [56].

Sustainability

Sustainability is defined as the extent to which a mailed FIT and patient navigation program are institutionalized in organizational practices and policies (RE-AIM framework). Using 6-month follow-up survey data and findings from key informant interviews, we assess the potential for sustainability across the clinics or organizations that implement each component of the program (i.e., mailed FIT and patient navigation). We assess potential for sustainment using PSAT domains (i.e., funding stability, partnerships, organizational capacity, program evaluation, communications, and strategic planning). We measure the extent to which program components become part of the routine organizational practices and policies using the RE-AIM framework [52].

Discussion

The SMARTER CRC scale-up study assesses a multicomponent mailed FIT and patient navigation intervention scaled up to be delivered to many types of organizations that serve rural populations. For the SMARTER CRC intervention to become sustainable without the research team support provided in the pragmatic trial, primary program implementation needs to shift from research-led to organization-led. During the scale-up study, we are able to assess the adaptations made by adopting organizations in order to implement a complex multi-level intervention. Our findings may impact how to broadly scale evidence-based CRC screening programs in rural settings.

The Translational Science Roadmap to Impact from the Translational Science Benefits Model [43] enables us to establish the core ECHO learning collaborative foci and recruitment targets. This model includes measurable indicators of clinical and community health impacts when examining translation of evidence-based practices into community interventions and clinical applications. The Going to Full-Scale framework [28] is another model for informing the potential adoption mechanisms and implementation support systems needed to broadly scale a program. The steps in the Barker et al. framework include setting up the program through planning and partner engagement, developing a “scalable unit” (i.e., the more generalizable SMARTER CRC intervention), testing the intervention in contexts likely to be encountered at full scale, and going to full scale (which facilitates adoption by a larger number of sites). Consistent with the framework, we can evaluate adoption mechanisms (e.g., engaging champions, training staff) and support systems (e.g., tracking systems) needed to achieve scale-up.

We chose to use the core components of the intervention implemented in the pragmatic trial but to leave the actual forms of those components flexible for the implementing scale-up organizations. We did this by presenting a facilitation guide that could be used in a flexible manner, a learning collaborative where organizations learned from each other in addition to expert faculty presenters, and individualized sessions where the material could be customized to different settings. We used the qualitative interview findings from the pragmatic trial and our advisory board input to indicate areas where the intervention needed refinement as we scaled up to new and different types of organizations. Planned interviews with organizations that adopt the intervention may further identity strategies to facilitate the implementation in practice.

While several existing frameworks [29, 30, 41, 45, 57] address scaling up evidence-based practices, some frameworks do not easily translate to specific situations. While the Barker et al. framework [28] gave us some insight into how to describe our work, ultimately we had to ask additional questions to apply this framework to our intervention and settings. We also could consider the Aarons et al. (2017) concept of “scaling out” evidence-based interventions (EBIs) to either new populations or delivery systems. Applying this model, we would say we both are scaling up, which they define as when an EBI designed for one setting is expanded to other health delivery units that are the same or very similar, and scaling out, with variants of implementation to different populations. In our case, some participating organizations serve populations that differ from the populations served by the clinical practices in the pragmatic trial. This scale-out framework is flexible enough to account for changes from the pragmatic trial to the spread to additional organizations.

Literature about scaling up multi-level interventions is evolving. Figuring out the suitable type and intensity of implementation strategies to support scale-up is also evolving. Our evaluation intends to inform the selection of core components for a CRC screening outreach program, whether the dissemination strategies we chose lead to successful adoption of any of the components and implementation strategies to scale a complex, multi-component intervention for rural healthcare settings.

Availability of data and materials

Not applicable.

Change history

Abbreviations

ACCSIS:

Accelerating Colorectal Cancer Screening and Follow-up through Implementation Science

CRC:

Colorectal cancer

CFIR:

Consolidated Framework for Implementation Research

PSAT:

Program Sustainability Assessment Tool

CSAT:

Clinical Sustainability Assessment Tool

ECHO:

Extension for Community Healthcare Outcomes

FIT:

Fecal immunochemical test

OHSU:

Oregon Health & Science University

FRAME:

Framework for Reporting Adaptations and Modifications–Expanded

FRAME-IS:

Framework for Reporting Adaptations and Modifications to Evidence-based Implementation Strategies

References

  1. D’Andrea E, Ahnen DJ, Sussman DA, Najafzadeh M. Quantifying the impact of adherence to screening strategies on colorectal cancer incidence and mortality. Cancer Med. 2020;9(2):824–36.

    Article  PubMed  Google Scholar 

  2. Bibbins-Domingo K, Grossman DC, Curry SJ, Davidson KW, Epling JW Jr, García FAR, et al. Screening for colorectal cancer: US preventive services task force recommendation statement. JAMA. 2016;315(23):2564–75.

    Article  CAS  PubMed  Google Scholar 

  3. Lin JS, Piper MA, Perdue LA, Rutter C, Webber EM, O’Connor E, et al. U.S. Preventive Services Task Force Evidence Syntheses, formerly systematic evidence reviews. Screening for colorectal cancer: a systematic review for the US Preventive Services Task Force. Rockville: Agency for Healthcare Research and Quality (US); 2016.

    Google Scholar 

  4. Jager M, Demb J, Asghar A, Selby K, Mello EM, Heskett KM, et al. Mailed outreach is superior to usual care alone for colorectal cancer screening in the USA: a systematic review and meta-analysis. Dig Dis Sci. 2019;64(9):2489–96.

    Article  PubMed  PubMed Central  Google Scholar 

  5. Gupta S, Coronado GD, Argenbright K, Brenner AT, Castañeda SF, Dominitz JA, et al. Mailed fecal immunochemical test outreach for colorectal cancer screening: summary of a centers for disease control and prevention-sponsored summit. CA Cancer J Clin. 2020;70(4):283–98.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Issaka RB, Avila P, Whitaker E, Bent S, Somsouk M. Population health interventions to improve colorectal cancer screening by fecal immunochemical tests: a systematic review. Prev Med. 2019;118:113–21.

    Article  PubMed  Google Scholar 

  7. Dougherty MK, Brenner AT, Crockett SD, Gupta S, Wheeler SB, Coker-Schwimmer M, et al. Evaluation of interventions intended to increase colorectal cancer screening rates in the United States: a systematic review and meta-analysis. JAMA Intern Med. 2018;178(12):1645–58.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Davis MM, Freeman M, Shannon J, Coronado GD, Stange KC, Guise JM, et al. A systematic review of clinic and community intervention to increase fecal testing for colorectal cancer in rural and low-income populations in the United States - how, what and when? BMC Cancer. 2018;18(1):40.

    Article  PubMed  PubMed Central  Google Scholar 

  9. Doubeni CA, Selby K, Levin TR. Disparities in preventable mortality from colorectal cancer: are they the result of structural racism? Gastroenterology. 2021;160(4):1022–5.

    Article  PubMed  Google Scholar 

  10. Coronado GD, Leo MC, Ramsey K, Coury J, Petrik AF, Patzel M, et al. Mailed fecal testing and patient navigation versus usual care to improve rates of colorectal cancer screening and follow-up colonoscopy in rural Medicaid enrollees: a cluster-randomized controlled trial. Implement Sci Commun. 2022;3(1):42.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Davis MM, Nambiar S, Mayorga ME, Sullivan E, Hicklin K, O’Leary MC, et al. Mailed FIT (fecal immunochemical test), navigation or patient reminders? Using microsimulation to inform selection of interventions to increase colorectal cancer screening in Medicaid enrollees. Prev Med. 2019;129s:105836.

    Article  PubMed  Google Scholar 

  12. Cusumano VT, Myint A, Corona E, Yang L, Bocek J, Lopez AG, et al. Patient navigation after positive fecal immunochemical test results increases diagnostic colonoscopy and highlights multilevel barriers to follow-up. Dig Dis Sci. 2021;66(11):3760–8.

    Article  PubMed  Google Scholar 

  13. Nelson HD, Cantor A, Wagner J, Jungbauer R, Fu R, Kondo K, et al. Effectiveness of patient navigation to increase cancer screening in populations adversely affected by health disparities: a meta-analysis. J Gen Intern Med. 2020;35(10):3026–35.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Hendren S, Winters P, Humiston S, Idris A, Li SX, Ford P, et al. Randomized, controlled trial of a multimodal intervention to improve cancer screening rates in a safety-net primary care practice. J Gen Intern Med. 2014;29(1):41–9.

    Article  PubMed  Google Scholar 

  15. Selby K, Jensen CD, Zhao WK, Lee JK, Slam A, Schottinger JE, et al. Strategies to improve follow-up after positive fecal immunochemical tests in a community-based setting: a mixed-methods study. Clin Transl Gastroenterol. 2019;10(2):e00010.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Coronado GD, Schneider JL, Petrik A, Rivelli J, Taplin S, Green BB. Implementation successes and challenges in participating in a pragmatic study to improve colon cancer screening: perspectives of health center leaders. Transl Behav Med. 2017;7(3):557–66.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Baldwin LM, Coronado GD, West II, Schwartz MR, Meenan RT, Vollmer WM, et al. Health plan-based mailed fecal testing for colorectal cancer screening among dual-eligible Medicaid/Medicare enrollees: outcomes of 2 program models. Cancer. 2022;128(2):410–8.

    Article  PubMed  Google Scholar 

  18. Petrik ACJ, Hiebert Larson J, Badicke B, Coronado GD, Davis MM. Data challenges in identifying patients due for colorectal cancer screening in rural clinics. J Am Board Fam Med. 2023;36(1):118–29. https://doi.org/10.3122/jabfm.2022.220216R1.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Rhode J, James S, Wheeler SB, Baker D, Drechsel R, Faile L, et al. Facilitators and barriers of a health department-based mailed fecal testing program. N C Med J. 2020;81(5):293–9.

    PubMed  Google Scholar 

  20. Davis MM, Coury J, Larson JH, Gunn R, Towey EG, Ketelhut A, et al. Improving colorectal cancer screening in rural primary care: preliminary effectiveness and implementation of a collaborative mailed fecal immunochemical test pilot. J Rural Health. 2023;39(1):279–90.

    Article  PubMed  Google Scholar 

  21. Pignone M, Lanier B, Kluz N, Valencia V, Chang P, Olmstead T. Effectiveness and cost-effectiveness of mailed FIT in a safety net clinic population. J Gen Intern Med. 2021;36(11):3441–7.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Kemper KE, Glaze BL, Eastman CL, Waldron RC, Hoover S, Flagg T, et al. Effectiveness and cost of multilayered colorectal cancer screening promotion interventions at federally qualified health centers in Washington State. Cancer. 2018;124(21):4121–9.

    Article  PubMed  Google Scholar 

  23. Somsouk M, Rachocki C, Mannalithara A, Garcia D, Laleau V, Grimes B, et al. Effectiveness and cost of organized outreach for colorectal cancer screening: a randomized, controlled trial. J Natl Cancer Inst. 2020;112(3):305–13.

    Article  PubMed  Google Scholar 

  24. Petrik AF, Green B, Schneider J, Miech EJ, Coury J, Retecki S, et al. Factors influencing implementation of a Colorectal Cancer Screening Improvement Program in community health centers: an applied use of configurational comparative methods. J Gen Intern Med. 2020;35:815.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Bernardo BM, Zhang X, Beverly Hery CM, Meadows RJ, Paskett ED. The efficacy and cost-effectiveness of patient navigation programs across the cancer continuum: a systematic review. Cancer. 2019;125(16):2747–61.

    Article  PubMed  Google Scholar 

  26. Gervès-Pinquié C, Girault A, Phillips S, Raskin S, Pratt-Chapman M. Economic evaluation of patient navigation programs in colorectal cancer care, a systematic review. Health Econ Rev. 2018;8(1):12.

    Article  PubMed  PubMed Central  Google Scholar 

  27. Liss DT, French DD, Buchanan DR, Brown T, Magner BG, Kollar S, et al. Outreach for annual colorectal cancer screening: a budget impact analysis for community health centers. Am J Prev Med. 2016;50(2):e54-61.

    Article  PubMed  Google Scholar 

  28. Barker PM, Reid A, Schall MW. A framework for scaling up health interventions: lessons from large-scale improvement initiatives in Africa. Implement Sci. 2016;11:12.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Accurso EC, Mu KJ, Landsverk J, Guydish J. Adaptation to family-based treatment for Medicaid-insured youth with anorexia nervosa in publicly-funded settings: protocol for a mixed methods implementation scale-out pilot study. J Eat Disord. 2021;9(1):99.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Tangka FKL, Subramanian S, Hoover S, Lara C, Eastman C, Glaze B, et al. Identifying optimal approaches to scale up colorectal cancer screening: an overview of the centers for disease control and prevention (CDC)’s learning laboratory. Cancer Causes Contr. 2019;30(2):169–75.

    Article  Google Scholar 

  31. Perez Jolles M, Lengnick-Hall R, Mittman BS. Core functions and forms of Complex Health Interventions: a patient-centered medical home illustration. J Gen Intern Med. 2019;34(6):1032–8.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Consortium A. Accelerating Colorectal Cancer Screening and Follow-up through Implementation Science (ACCSIS): RTI International; 2022. Available from: https://accsis.rti.org/.

  33. Coury JK, Schneider JL, Green BB, Baldwin LM, Petrik AF, Rivelli JS, et al. Two Medicaid health plans’ models and motivations for improving colorectal cancer screening rates. Transl Behav Med. 2020;10(1):68–77.

    Article  PubMed  Google Scholar 

  34. Thompson JH, Davis MM, Leo MC, Schneider JL, Smith DH, Petrik AF, et al. Participatory Research to Advance Colon Cancer Prevention (PROMPT): study protocol for a pragmatic trial. Contemp Clin Trials. 2018;67:11–5.

    Article  PubMed  PubMed Central  Google Scholar 

  35. DeGroff A, Gressard L, Glover-Kudon R, Rice K, Tharpe FS, Escoffery C, et al. Assessing the implementation of a patient navigation intervention for colonoscopy screening. BMC Health Serv Res. 2019;19(1):803.

    Article  PubMed  PubMed Central  Google Scholar 

  36. Corôa RC, Gogovor A, Ben Charif A, Hassine AB, Zomahoun HTV, McLean RKD, et al. Evidence on scaling in health and social care: an umbrella review. Milbank Q. 2023;101(3):881–921.

    Article  PubMed  Google Scholar 

  37. Ghiron L, Shillingi L, Kabiswa C, Ogonda G, Omimo A, Ntabona A, et al. Beginning with sustainable scale up in mind: initial results from a population, health and environment project in East Africa. Reprod Health Matters. 2014;22(43):84–92.

    Article  PubMed  Google Scholar 

  38. Organization EWH. Practical guidance for scaling up health service innovations. Geneva: World Health Organization; 2009.

    Google Scholar 

  39. Myers EH-ONA, Kenzie E, Coury J, Petrik A, Petrik G, Davis M. Implementing mailed FIT and patient navigation in rural settings: preliminary qualitative findings from the SMARTER CRC study. Portland: Western Colorectal Cancer Consortium Conference; 2023.

    Google Scholar 

  40. Kenzie ES KM, Badicke B, Coronado G, Coury J, and Davis MM. Making sense of complexity underlying two CRC screening interventions using causal-loop diagramming. Annual Conference on the Science of Dissemination and Implementation in Health. Washington, DC; 2021. Virtual2021.

  41. Brown CH, Curran G, Palinkas LA, Aarons GA, Wells KB, Jones L, et al. An overview of research and evaluation designs for dissemination and implementation. Annu Rev Public Health. 2017;38:1–22.

    Article  PubMed  PubMed Central  Google Scholar 

  42. McDonnell MM, Elder NC, Stock R, Wolf M, Steeves-Reece A, Graham T. Project ECHO integrated within the Oregon Rural Practice-based Research Network (ORPRN). J Am Board Fam Med. 2020;33(5):789–95.

    Article  PubMed  Google Scholar 

  43. Luke DA, Sarli CC, Suiter AM, Carothers BJ, Combs TB, Allen JL, et al. The translational science benefits model: a new framework for assessing the health and societal benefits of clinical and translational sciences. Clin Transl Sci. 2018;11(1):77–84.

    Article  PubMed  Google Scholar 

  44. Davis MM, Howk S, Spurlock M, McGinnis PB, Cohen DJ, Fagnan LJ. A qualitative study of clinic and community member perspectives on intervention toolkits: “Unless the toolkit is used it won’t help solve the problem“. BMC Health Serv Res. 2017;17(1):497.

    Article  PubMed  PubMed Central  Google Scholar 

  45. Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4:50.

    Article  PubMed  PubMed Central  Google Scholar 

  46. Damschroder LJ, Reardon CM, Widerquist MAO, Lowery J. The updated consolidated framework for implementation research based on user feedback. Implement Sci. 2022;17(1):75.

    Article  PubMed  PubMed Central  Google Scholar 

  47. Luke DA, Calhoun A, Robichaux CB, Elliott MB, Moreland-Russell S. The program sustainability assessment tool: a new instrument for public health programs. Prev Chronic Dis. 2014;11: 130184.

    Article  PubMed  Google Scholar 

  48. Miller WL, Crabtree BF. Qualitative analysis: how to begin making sense. Fam Pract Res J. 1994;14(3):289–97.

    CAS  PubMed  Google Scholar 

  49. Kelders SM, van Zyl LE, Ludden GDS. The concept and components of engagement in different domains applied to ehealth: a systematic scoping review. Front Psychol. 2020;11:926.

    Article  PubMed  PubMed Central  Google Scholar 

  50. Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. 1999;89(9):1322–7.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  51. Glasgow RE, Harden SM, Gaglio B, Rabin B, Smith ML, Porter GC, et al. RE-AIM planning and evaluation framework: adapting to new science and practice with a 20-year review. Front Public Health. 2019;7:64.

    Article  PubMed  PubMed Central  Google Scholar 

  52. Estabrooks PA, Gaglio B, Glasgow RE, Harden SM, Ory MG, Rabin BA, et al. Editorial: use of the RE-AIM framework: translating research to practice with novel applications and emerging directions. Front Public Health. 2021;9:691526.

    Article  PubMed  PubMed Central  Google Scholar 

  53. Miller CJ, Barnett ML, Baumann AA, Gutner CA, Wiltsey-Stirman S. The FRAME-IS: a framework for documenting modifications to implementation strategies in healthcare. Implement Sci. 2021;16(1):36.

    Article  PubMed  PubMed Central  Google Scholar 

  54. Wiltsey Stirman S, Baumann AA, Miller CJ. The FRAME: an expanded framework for reporting adaptations and modifications to evidence-based interventions. Implement Sci. 2019;14(1):58. https://doi.org/10.1186/s13012-019-0898-y.

    Article  PubMed  PubMed Central  Google Scholar 

  55. Miller CJ, Barnett ML, Baumann AA, Gutner CA, Wiltsey-Stirman S. The FRAME-IS: a framework for documenting modifications to implementation strategies in healthcare. Implement Sci IS. 2021;16(1):36.

    Article  PubMed  Google Scholar 

  56. Coronado GD, Schneider JL, Green BB, Coury JK, Schwartz MR, Kulkarni-Sharma Y, et al. Health plan adaptations to a mailed outreach program for colorectal cancer screening among Medicaid and Medicare enrollees: the BeneFIT study. Implement Sci. 2020;15(1):77. https://doi.org/10.1186/s13012-020-01037-4.

    Article  PubMed  PubMed Central  Google Scholar 

  57. Aarons GA, Sklar M, Mustanski B, Benbow N, Brown CH. “Scaling-out” evidence-based interventions to new populations or new health care delivery systems. Implement Sci. 2017;12(1):111.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

We would like to acknowledge the members of both our Local Advisory Board and National Advisory Board who guided us throughout the various phases of the study. We would also like to acknowledge Tiffany Weekley who provided administrative assistance and support.

Funding

Funding from the National Cancer Institute: The Accelerating Colorectal Cancer Screening and Follow-up through Implementation Science (ACCSIS) Program is a Beau Biden Cancer Moonshot℠ Initiative. Research was supported by the National Cancer Institute of the National Institutes of Health under award no. UH3CA244298, screening more patients for CRC through Adapting and Refining Targeted Evidence-based Interventions in Rural settings. The content is solely the responsibility of the authors and does not necessarily represent the official views of the NIH.

Author information

Authors and Affiliations

  1. Oregon Rural Practice-Based Research Network, Oregon Health & Science University (OHSU), 3181 SW Sam Jackson Park Rd, Portland, OR, 97239, USA

    Jennifer Coury, Erin S. Kenzie, Brittany Badicke, Emily Myers & Melinda M. Davis

  2. Kaiser Permanente Center for Health Research, Portland, USA

    Gloria Coronado & Amanda F. Petrik

  3. Division of Oncological Sciences, Knight Cancer Institute, OHSU, Portland, USA

    Jessica J. Currier

  4. OHSU-PSU School of Public Health, OHSU, Portland, USA

    Melinda M. Davis

  5. Department of Family Medicine, OHSU, Portland, USA

    Erin S. Kenzie & Melinda M. Davis

Authors
  1. Jennifer Coury
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Gloria Coronado
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jessica J. Currier
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Erin S. Kenzie
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Amanda F. Petrik
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Brittany Badicke
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Emily Myers
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Melinda M. Davis
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

JC drafted the manuscript, and all authors contributed to writing the manuscript. GDC and MMD conceptualized the study. JC manages the implementation of the study and serves as lead faculty for the ECHO sessions. JJC and AFP lead development of the statistical analysis plan and are leading the mixed-method evaluation components. BB leads the recruitment and contributes to management of the implementation. ESK, MMD, and JJC developed the qualitative analysis plan, and EM and JJC are gathering qualitative data; all authors have read and approved the manuscript.

Corresponding author

Correspondence to Jennifer Coury.

Ethics declarations

Ethics approval and consent to participate

SMARTER CRC has obtained approval from the OHSU’s Institutional Review Board (protocol number: 20681), which has granted a waiver of informed consent. A ceding agreement was obtained from Kaiser Permanente Center for Health Research.

Consent for publication

Not applicable.

Competing interests

From 2020- 2022, Dr. Coronado served as a scientific advisor for Exact Sciences, through a contract with the Kaiser Permanente Center for Health Research. From 2021 – 2023, Dr. Coronado served as Principal Investigator on a study funded by Guardant Health, through a contract with Kaiser Permanente Center for Health Research, to assess the adherence to a commercially available blood test for colorectal cancer. The rest of the authors declare they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

The original version of this article was revised: The Competing Interest section contained outdated information and has been updated.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Coury, J., Coronado, G., Currier, J.J. et al. Methods for scaling up an outreach intervention to increase colorectal cancer screening rates in rural areas. Implement Sci Commun 5, 6 (2024). https://doi.org/10.1186/s43058-023-00540-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s43058-023-00540-1

Keywords

Implementation Science Communications

ISSN: 2662-2211