- Study protocol
- Open Access
Mailed fecal testing and patient navigation versus usual care to improve rates of colorectal cancer screening and follow-up colonoscopy in rural Medicaid enrollees: a cluster-randomized controlled trial
Implementation Science Communications volume 3, Article number: 42 (2022)
Screening reduces incidence and mortality from colorectal cancer (CRC), yet US screening rates are low, particularly among Medicaid enrollees in rural communities. We describe a two-phase project, SMARTER CRC, designed to achieve the National Cancer Institute Cancer MoonshotSM objectives by reducing the burden of CRC on the US population. Specifically, SMARTER CRC aims to test the implementation, effectiveness, and maintenance of a mailed fecal test and patient navigation program to improve rates of CRC screening, follow-up colonoscopy, and referral to care in clinics serving rural Medicaid enrollees.
Phase I activities in SMARTER CRC include a two-arm cluster-randomized controlled trial of a mailed fecal test and patient navigation program involving three Medicaid health plans and 30 rural primary care practices in Oregon and Idaho; the implementation of the program is supported by training and practice facilitation. Participating clinic units were randomized 1:1 into the intervention or usual care. The intervention combines (1) mailed fecal testing outreach supported by clinics, health plans, and vendors and (2) patient navigation for colonoscopy following an abnormal fecal test result. We will evaluate the effectiveness, implementation, and maintenance of the intervention and track adaptations to the intervention and to implementation strategies, using quantitative and qualitative methods. Our primary effectiveness outcome is receipt of any CRC screening within 6 months of enrollee identification. Our primary implementation outcome is health plan- and clinic-level rates of program delivery, by component (mailed FIT and patient navigation). Trial results will inform phase II activities to scale up the program through partnerships with health plans, primary care clinics, and regional and national organizations that serve rural primary care clinics; scale-up will include webinars, train-the-trainer workshops, and collaborative learning activities.
This study will test the implementation, effectiveness, and scale-up of a multi-component mailed fecal testing and patient navigation program to improve CRC screening rates in rural Medicaid enrollees. Our findings may inform approaches for adapting and scaling evidence-based approaches to promote CRC screening participation in underserved populations and settings.
Registered at clinicaltrial.gov (NCT04890054) and at the NCI’s Clinical Trials Reporting Program (CTRP #: NCI-2021-01032) on May 11, 2021.
Colorectal cancer (CRC) is the third-leading cause of cancer death in the USA [1, 2]. CRC is 90% curable with timely detection and appropriate treatment of precancerous growths . If not found until a patient is symptomatic, however, survival rates drop to 50% . While CRC screening could prevent up to 60% of deaths from CRC, approximately 33% of US adults aged 50–75 (25 million people) are not currently up to date with CRC screening guidelines  . Moreover, recent changes to the US Preventive Services Task Force guidelines, calling for the initiation of CRC screening at age 45 rather than 50, will result in over 20 million additional adults needing CRC screening services [7,8,9].
Rates of CRC screening are particularly low among adults in rural communities and among specific sub-populations within these settings, including Medicaid enrollees [3, 10,11,12]. Rural areas cover 97% of the US land area and are home to about 60 million people . CRC incidence and mortality are disproportionately high among residents of rural regions compared to residents of urban regions [11, 14]; these disparities are driven primarily by differences in adherence to screening guidelines [11, 15]. Medicaid enrollees are a key underserved group in rural areas. In 2019, Medicaid provided health insurance and access to preventive health services to 71 million people, including nearly 1 in 4 rural US residents under age 65 (24%) [16,17,18]. Medicaid members between the ages of 50 and 64 years have relatively low rates of CRC screening (54%) compared to commercially insured adults in the same age group (65%) [19, 20]. Moreover, administrative claims data from Oregon show that newly age-eligible Medicaid enrollees (i.e., those turning 50) are 33% less likely to initiate CRC screening compared to newly age-eligible commercially insured adults . Medicaid members also have less favorable CRC outcomes on average than commercially insured adults [22, 23].
Interventions are needed to address disparities in CRC screening and follow-up in rural Medicaid enrollees. Fecal immunochemical testing (FIT) is a convenient at-home screening strategy recommended by the US Preventive Services Task Force; adults with an abnormal FIT result must obtain a follow-up colonoscopy to find and remove polyps or find cancers at early stages. Several systematic reviews have highlighted the success of mailed FIT outreach as a strategy to improve rates of CRC screening, demonstrating greater CRC screening improvements than with other strategies [24,25,26,27]. Patient navigation has also demonstrated promise for raising rates of follow-up colonoscopy completion among individuals with abnormal FIT results [28,29,30]. Findings from microsimulation modeling conducted by our team show that combining mailed FIT outreach with patient navigation is a cost-effective strategy that can lead to CRC screening rates within Medicaid enrollees that exceed national CRC screening targets over 5 years of implementation .
Our study, Screening More patients for CRC through Adapting and Refining Targeted Evidence-based Interventions in Rural settings (SMARTER CRC), evaluates the implementation of a targeted, multi-level program that incorporates tailored mailed FIT outreach and patient navigation to address CRC disparities in rural Medicaid populations. Through the course of a large-scale pragmatic trial plus a scale-up study, we anticipate working with more than 20 regional and national organizations to facilitate the program’s implementation in an estimated 160 rural primary care clinics (serving over 21,000 rural Medicaid patients aged 50–75). We will assess adaptations and drivers of program success at the patient, clinic, health plan, vendor, and policy levels. This study fills key evidence and implementation gaps and will support President Biden’s Cancer MoonshotSM objectives by developing a model for how to rapidly adapt and scale-up multi-level interventions through clinic-health plan-vendor partnerships to reduce the burden of CRC on the US population.
SMARTER CRC is being conducted as part of the NCI-funded consortium, the Accelerating Colorectal Cancer Screening and Follow-up through Implementation Science (ACCSIS) Program. The overall aim of ACCSIS is to conduct multi-site, coordinated, transdisciplinary research to evaluate and improve CRC screening processes using implementation science strategies. SMARTER CRC is a large-scale, parallel, cluster-randomized study involving three Medicaid health plans and 30 rural clinics, followed by a scale-up study involving 130 rural practices. A cluster-randomized design was chosen because it could minimize the potential for contamination (versus individual-randomized designs) and could minimize bias due to changes in secular trends (versus stepped-wedge designs). Clinic units were randomized either to implement mailed FIT outreach along with a tailored patient navigation program to promote timely follow-up for abnormal FIT or to continue providing usual care. The intervention program was tailored for rural Medicaid populations using Boot Camp Translation , with components delivered by the health plan, clinic, and a direct-mail vendor. We will evaluate effectiveness by comparing rates of any CRC screening in eligible enrollees in the intervention and usual care clinics. We will also assess adaptations made prior to, during, or following program implementation, as well as the program’s implementation, and second-year maintenance. The study is a collaborative partnership between the Oregon Health & Science University’s Oregon Rural Practice-based Research Network and the Kaiser Permanente Northwest Center for Health Research. Study activities build on prior mailed FIT and patient navigation implementation research conducted by our team [32,33,34,35,36,37,38,39,40,41,42,43,44], best practices identified at a Centers for Disease Control Mailed FIT Summit , rural cancer control recommendations by rural health experts , participatory implementation science principles , and formative research conducted by the Community Health Advocacy and Research Alliance [31, 48,49,50].
SMARTER CRC has obtained approval from the Oregon Health & Science University’s Institutional Review Board (protocol number: 20681), which has granted a waiver of informed consent because the study involves minimal risks to enrollees and could not practicably be conducted without the waiver. A ceding agreement was obtained from Kaiser Permanente Center for Health Research. The study will be monitored by the MPIs, following an established internal data safety monitoring plan.
The project team invited participation from eight health plans that serve rural counties in Oregon; three health plans agreed to participate (37.5%). All three health plans are Coordinated Care Organizations (CCOs), networks of heath care providers (physical, mental, and dental) who work with local communities to provide coordinated care to individuals covered on Medicaid. The three participating CCOs are Eastern Oregon CCO (EOCCO), Cascade Health Alliance (CHA), and PacificSource. PacificSource is organized into administrative entities that cover three distinct regions participating in SMARTER CRC: PacificSource-Central, PacificSource-Gorge, and PacificSource-Marion and Polk Counties. In 2021, these CCOs provided Medicaid and dual-eligible coverage to 296,047 people in Oregon (64,902 at EOCCO; 23,912 at CHA; and 207,233 at PacificSource). The 2019 Medicaid CRC screening rate was 51% for EOCCO and 52% for CHA, and the 2021 Medicaid CRC screening rate was 62% for PacificSource (62% for PacificSource-Central, 63% for PacificSource-Gorge, and 62% for PacificSource-Marion and Polk Counties).
All participating CCOs provide coverage with no out-of-pocket costs to Medicaid enrollees for FIT, colonoscopy, sigmoidoscopy, CT colonography, and follow-up colonoscopy after an abnormal test result in alignment with Oregon policy [51, 52]. For dual-eligible enrollees, health plans also cover multi-target stool DNA (mt-sDNA). CRC screening is covered for all CCO enrollees aged 50–75 years, and in 2021 coverage was expanded to include adults aged 45–49 years to align with the recent US Preventive Services Task Force guideline changes [53, 54].
Participating CCOs promote CRC screening in a variety of ways. In prior years, a subset of EOCCO clinics (4 clinics in 2017, 6 clinics in 2018, and 5 clinics in 2019) conducted a mailed FIT outreach program using the collaborative clinic-health plan-vendor model from the BeneFIT study (same model as the present study; the present study uses rural-adapted materials) [55,56,57]. Implementation support was provided to EOCCO clinics by our team at the Oregon Rural Practice-based Research Network. CHA has also engaged in previous mailed FIT outreach efforts, including a 2019 effort in which they directly mailed FITs to Medicaid enrollees and a 2020 effort in which they provided FITs to one large, affiliated clinic which mailed them to Medicaid enrollees. In 2018, PacificSource-Gorge operated a mailed FIT outreach program for Medicaid enrollees receiving care at three rural clinics as part of a pilot study led by our team. Since 2018, PacificSource has contracted with a vendor to run a system-wide mailed outreach program to all Medicare enrollees in the Gorge and Central Oregon (n = 6795 in 2021), and in 2019 expanded the program to include prior-year FIT-screened Medicaid enrollees (n = 239 in 2021). The SMARTER CRC intervention will be overlaid on these existing screening promotion efforts.
The project team (MPI, research associate, project manager, practice facilitator) collaborated with the participating CCOs to recruit affiliated clinics. To be eligible for participation in the study, clinics had to have at least 30 age-eligible Medicaid or dual-eligible enrollees, have a CRC screening rate of 60% or lower, and be in a geographic region designated as rural or frontier by the Oregon Office of Rural Health or have a Rural-Urban Commuting Area code of 4 or higher [58,59,60]. For EOCCO, CHA, and most PacificSource regions, we used clinic-level Medicaid claims data from 2019 for enrollees aged 50–75 to determine clinic eligibility. For clinics in one PacificSource region, 2019 claims data were unavailable; thus, we used claims data from 2021. We opted not to use data from 2020 because the care suspensions during the COVID pandemic led to temporary reductions in CRC screening rates. A total of 33 clinics (organized into 29 clinic units for randomization) were recruited between May 2020 and February 2021; each signed a participant agreement letter confirming their plans to participate in the study. Clinics generally offer opportunistic screening through in-clinic FIT distribution or referral to colonoscopy; some offer mt-sDNA to patients with Medicare or commercial insurance.
Our study has the following aims:
Aim 1: Conduct a large-scale pragmatic study, using a two-arm cluster-randomized design, to assess the implementation, effectiveness, and maintenance of a direct mail and patient navigation CRC screening program in 30 rural primary care clinics (n ~ 3960 patients aged 50–64), using practice facilitation to support implementation. Using a mixed methods approach, identify patient-, clinic/health system-, and payer/policy/community-level factors that are associated with reach, effectiveness, implementation, and maintenance of the program, and assess program adaptations.
Aim 2: Partner with regional and national organizations (n ~ 20) to scale up the program to clinics serving rural and underserved patients in high-priority geographic regions of the USA (n ~ 130 clinics; 17,000+ patients) using webinars, train-the-trainer workshops, and collaborative learning approaches. Assess trainings delivered, program adoption and adaptations, and determinants of dissemination success.
Aim 1: large-scale, cluster-randomized pragmatic study
To realize aim 1, we will assess the implementation, effectiveness, and maintenance of the mailed FIT outreach and patient navigation program using a two-arm, parallel, cluster-randomized design conducted over the course of 2 years. Our mailed FIT outreach program uses a collaborative clinic-health plan-vendor model designed and pilot-tested by our team as part of the BeneFIT study  and adapted for rural regions [55, 56]. The patient navigation component uses the New Hampshire Colorectal Cancer Screening Program , with adaptations based on prior implementations by our study team and pilot-testing for rural clinics [44, 62]. The implementation of the multi-component program is supported by workflow mapping, formal training, and ongoing implementation support provided by practice facilitators and other members of the research team. Figure 1 displays the activities for the program.
Beginning with an initial list of 33 recruited clinics, we created three small clusters of clinics (two pairs and one trio) within the same health system to serve as randomization units. These clinics had common staff or enrollees, lacked claims data at the level of individual clinics, or were too small to otherwise meet eligibility criteria. This resulted in 29 clinic units for randomization.
Units were randomized 1:1 into intervention and control groups. Randomization was stratified on health system designation (e.g., hospital-affiliated clinics or independent clinics) and performed by the project statistician in two batches in April 2021 (2 CCOs) and May 2021 (1 CCO), with timing based on data availability. Each batch consisted of five strata, with 2–6 clinic units within a stratum. The randomized allocation sequence was generated using STATA version 16 (College Station, TX). The study condition (intervention or usual care) was randomly assigned during a virtual ‘roll of dice’ meeting attended by health plan and clinic representatives, with the intervention group being offered the intervention during year 1 of the study (April 2021) and the control group being offered the intervention during year 2 of the study (April 2022). Fifteen units were assigned to intervention and 14 units were assigned to usual care. For practical reasons, the research team and the clinic staff were unblinded to randomization assignment.
Selection of eligible enrollees
On an annual basis, CCO staff use claims data to generate a list of eligible enrollees for each clinic assigned to the intervention; eligible enrollees are aged 50–75, enrolled in Medicaid or dually enrolled in Medicaid and Medicare, and due for CRC screening (no claims evidence of colonoscopy within past 10 years, flexible sigmoidoscopy or CT colonography within 5 years, FIT within the past year, or mt-sDNA in the past 3 years). The study team enters the list into a cloud-based database, REDCap (Fort Lauderdale, FL). Clinic staff then may use the list to conduct a “scrub” of the data to remove the names of any enrollee who, based on electronic health record (EHR) data, is not due for CRC screening, has life-limiting comorbid conditions, is otherwise ineligible for FIT testing, or has not established care at the clinic .
Mailed FIT outreach
For the mailed FIT outreach component, scrubbed lists are sent to a vendor (PrintSync Inc. [Beaverton, Oregon], Koko Graphix [Klamath Falls, Oregon], or Home Access Health Corporation [Hoffman Estates, IL]) who delivers outreach to enrollees on the list. For EOCCO and CHA, the vendor mails introduction letters (tailored for rural clinics [32, 63, 64]) to all enrollees on the list, followed 1 week later by a FIT test, with instructions to return the test by mail to the clinic or the clinic’s designated laboratory for processing. Mailed with the FIT are a wordless FIT instruction sheet , a letter (also tailored for rural clinics), and a pre-addressed and postage-paid envelope. For CHA and PacificSource, the vendor also delivers a reminder (via text message or letter) about 2 weeks after the FIT mailing. The mailed FIT test is the same one-sample FIT test used in-clinic, when possible; tests used in clinic include OC-Auto® and OC-Light®S by PolyMedco (Cortland Manor, NY); Insure®ONE™ by Clinical Genomics (Edison, NJ); Hemosure® iFOB Test Kit by Hemosure, Inc. (Irwindale, CA); and Henry Schein OneStep+ by Henry Schein Inc. (Melville, NY)). If the test normally used by a clinic is not mailable or if the clinic cannot provide their normal FIT test for the mailing program, the OC-Auto® FIT is used. For PacificSource, the vendor mails and processes the FITs; that is, the vendor mails a single brand FIT test (OC-Auto®), which includes an introduction letter (the letter is not mailed separately), a pre-paid envelope for FIT return, and instructions to mail the kit to the vendor laboratory for processing.
Intervention clinic staff are encouraged to make a live outreach call to enrollees, either before or after the FIT mailing, in accordance with mailed FIT program best practices . Phone calls and texts are tracked in the REDCap database. Consistent with usual care, enrollees whose FIT results are abnormal and who need a colonoscopy are referred to either internal surgical centers or colonoscopy providers (for some clinics affiliated with a hospital) or to external gastroenterology specialty care facilities (hospital or ambulatory surgical center) in the regional area of the clinic. These enrollees are contacted by clinic staff who are trained in patient navigation to initiate the patient navigation component of the program. CCO staff are also offered training to provide patient navigation for clinics that are unable to staff this component of the intervention.
The adapted patient navigation program is phone-based and covers four topic areas (the original program consisted of 6 topic areas) [44, 61, 62]. The navigators are clinic staff or CCO staff trained by the research team. During the initial topic call, the navigator introduces the program, assesses barriers, and collaborates with the enrollees to resolve barriers (this can require multiple phone calls). The subsequent three calls are timed to the colonoscopy appointment, with a call delivered 1 week prior to the colonoscopy appointment focused on colonoscopy preparation, another call delivered the day before the colonoscopy to check-in with the patient, and a final call delivered 2 weeks following the procedure focused on assuring that the enrollee understands the results. Additionally, 2 weeks after laboratory results are returned, the care management team of one CCO (PacificSource) calls enrollees with abnormal results to encourage them to schedule a follow-up colonoscopy. Navigation activities and enrollee outcomes are tracked in the REDCap database and in each clinic’s EHR.
Implementation support activities
Study activities will be primarily facilitated by the project manager, practice facilitators (who are members of the research team), and other study team members with relevant expertise (e.g., data analysis, patient navigation). Practice facilitation is increasingly used as a centralized and unifying strategy to build practice capacity [65, 66] and support implementation that is tailored to the local context and stakeholder needs [66,67,68,69,70,71,72,73]. Three practice facilitators from the Oregon Rural Practice-based Research Network serve as liaisons between the researchers, CCOs, and clinics. They are trained in practice facilitation, quality improvement, CRC screening outreach methods, and study-specific data collection methods. Practice facilitators maintain ongoing contact with the clinical teams (e.g., clinical champion, point of contact, and implementation teams) implementing the program. Ongoing contact includes helping to determine needed intervention adaptations, arranging attendance at trainings and delivering certain training elements, notifying clinic staff of key intervention steps (such as mailing events or data uploads), and providing ongoing implementation support. The facilitators also support re-training and re-engagement following clinical staff turnover or role changes. For SMARTER CRC, facilitation activities consist of formal workflow assessments and scheduled or ad hoc meetings with clinical teams by phone, video conferencing, or email. In addition, a monthly meeting is held among the research project team, CCO representatives, and staff from all intervention clinics involved in the project, including patient navigators. The purpose of this meeting is to provide overall project status updates, facilitate collaboration, make mid-course corrections, receive booster training, and identify needed adaptations to the intervention. While facilitation activities were predominantly planned for in-person delivery, we shifted to remote interactions due to COVID-19-related travel restrictions.
CCO and clinic staff training
Intervention training activities cover how to scrub patient lists for mailed FIT eligibility and how to conduct patient navigation. For the scrub training, two research team members (a project manager and research associate or practice facilitator) train clinical staff from each intervention clinic in how to review lists of enrollees and remove names of enrollees determined to be ineligible based on health record data (two training sessions were held to accommodate the roll-out timing of the different CCO FIT mailings) with supplemental follow-up to answer questions as needed. The scrub training lasts about 60 min, and a recorded version of the training is offered via a web link to participants for later viewing or to train new staff. In addition, a 5-h patient navigation training is provided; this training was adapted from the PRECISE study . The patient navigation training includes a series of pre-recorded videos (total duration: 60 min) on the importance of CRC screening and follow-up and the role of patient navigation; two 90-min live interactive webinar sessions focused on personal and structural barriers to colonoscopy, effective messages to promote follow-up colonoscopy, and interactive role-playing; a 60-min live interactive webinar session on using the REDCap system to track patient navigation interactions; and an optional 60-min pre-recorded video session on motivational interviewing. The patient navigation training is offered to at least one staff member in each participating intervention clinic.
To understand current CRC screening and follow-up practices within a given clinic, practice facilitators conduct workflow assessments in collaboration with staff at clinics assigned to the intervention. Two workflow assessment meetings are held: The initial meeting primarily focuses on the mailed FIT component; the second meeting primarily focuses on the patient navigation component. During these meetings, practice facilitators create visual ‘swim lane’ diagrams using Lucidchart© (South Jordan, UT). As part of the facilitated workflow assessment, clinic staff describe their current CRC screening process, choose program components to implement (e.g., live call reminders for mailed FIT) and aspects of program implementation (e.g., minimum number of navigation call attempts before an enrollee is considered unreachable), and discuss any planned adaptations. Workflow diagrams are then reviewed with clinic staff and research team members and refined based on feedback. Based on the workflow, clinic staff assign leads for the mailed FIT and patient navigation components.
We will evaluate intervention effectiveness by assessing whether enrollees in the intervention clinics are more likely to obtain any CRC screening compared to patients in the usual care clinics within 6 months of the date the enrollees were identified as eligible (claims list pull date) (Table 1). Additional effectiveness outcomes include receipt of FIT, time to FIT completion, and FIT result; receipt of screening colonoscopy; and among those with an abnormal FIT result, referral to follow-up colonoscopy, follow-up colonoscopy receipt, and time to colonoscopy. We also will assess colonoscopy outcomes (e.g., n adenomas, cancers detected) and referral to cancer care among those with cancer detected. To obtain data for outcomes unavailable in claims data (FIT positivity, etc.), practice facilitators will conduct chart audits in each participating clinic (at 1 year after the FIT mailing date). Primary analyses will rely on intention-to-treat; that is, enrollees will retain their unit at the time of randomization assignment irrespective of whether they received the mailed FIT and patient navigation intervention (analysis will retain enrollees who are removed during the scrub process) or transfer care to another randomization unit during follow-up. Because we do not anticipate having auxiliary variables that correlate greater than .50 with the outcome that would allow us to use multiple imputation [74, 75], we will handle missing outcome data for eligible enrollees who are lost to follow-up by assuming these enrollees did not complete any CRC screening. In addition, we will conduct a sensitivity analysis by dropping patients with missing outcome data because of CCO disenrollment (i.e., listwise deletion).
We will use hierarchical generalized linear modeling to account for clustering of enrollees within clinics in our assessment of intervention effectiveness (clinic level), implementation, and maintenance (CCO, clinic, and enrollee levels) . Because the primary outcome is binary (i.e., any CRC screening, yes/no), we will use a model with a logit link and binomial distribution (i.e., multi-level logistic regression). The independent variable will be arm (dummy-coded) with usual care as the reference group. Clinic (or clinic cluster) will be modeled as a random effect. Odds ratios >1 support the hypothesis that the adapted mailed FIT program with patient navigation support increases the likelihood of an enrollee obtaining any CRC screening compared to usual care. A similar framework will be used for the other binary outcome variables (e.g., receipt of FIT, receipt of screening colonoscopy, referral to follow-up colonoscopy, receipt of follow-up colonoscopy). To compare time to FIT and time to follow-up colonoscopy, we will use Cox proportional hazards regression with shared frailty to account for the clustering of patients nested within clinics.
Sample size and power
Assuming a balanced, two-arm, cluster-randomized trial, 106 patients per clinic, an intra-class correlation (ICC) of .03, and a pre-implementation (baseline) CRC screening rate of 44.6%, we will have 79.5% power to detect a clinically meaningful change in screening rates as small as 10% in the intervention group (an increase to 54.6%) following program implementation using a two-tailed alpha level of .05. Pre-implementation (baseline) CRC screening rates were determined by reviewing clinic-level data from EOCCO and excluding clinics with a CRC screening rate above 60%. The minimum detectable effect size (MDES) to achieve 80% power is 10.1%, using the same assumptions. For ICC values ranging between .01 and .05, power ranges from 97.7 to 62.1%, and MDES to achieve 80% power range from 7.1 to 12.3%, indicating moderate sensitivity to the value of the ICC [77, 78]. Power calculations were determined using PASS 15 .
We will evaluate intervention implementation by assessing the extent to which intervention clinics deliver the program, by component (for mailed FIT: within 6 months of the date the enrollees were identified as eligible (claims list pull date); for patient navigation within 6 months of the abnormal FIT result date). Additional implementation outcomes include implementation of non-core components (e.g., list scrubbing at the clinic level, mailed FIT reminders at the CCO and clinic levels), reach, acceptability (measured at the CCO, clinic, colonoscopy provider/staff, and enrollee levels), barriers and facilitators, and program adaptations (desired and executed). We will also track the number of CCO and clinic staff who participate in the scrub training and patient navigation training. Implementation will be assessed using mixed methods, that is, data in REDCap (intervention activities) and vendor data (intervention activities and screening events) as well as findings from a baseline intake survey, one-on-one qualitative interviews (conducted before and after implementation), field notes taken by practice facilitators, and periodic reflections among members of the study team.
Clinic intake survey
Prior to randomization, a clinic intake survey was completed by all participating clinics. The clinic intake survey was developed using common data elements from the ACCSIS consortium. The survey asks about what CRC screening tests the clinic uses, CRC screening rates, rates of follow-up colonoscopy, and characteristics of the health system to which the clinic belongs. The survey was managed using REDCap; links to the survey were distributed by email to the primary point of contact in all recruited clinics (intervention and usual care); practice facilitators followed up with clinic staff, as needed, to obtain answers to any skipped questions and to document survey questions for which the answer could not be easily obtained.
Semi-structured qualitative interviews among CCO leaders in quality improvement roles (n ~ 3), clinic staff (clinic managers, quality improvement staff, physicians; n ~ 30), and clinicians and staff from colonoscopy facilities (clinic managers, scheduling/referral staff, billing specialist, or clinicians; n ~ 20) are conducted prior to the FIT mailing and after implementation. These interviews will be conducted in intervention and usual care clinics. Practice facilitators will conduct informal qualitative interviews with enrolled clinics 6–9 months from the year 1 FIT mailing for the purpose of informing year 2 implementation. Interviews with clinic and CCO staff seek to understand contextual factors, barriers and facilitators to implementation and maintenance, program acceptability and adaptations (both desired and executed), and unanticipated consequences (positive or negative). Interviews with clinicians performing colonoscopy and their staff seek to understand their awareness of and reaction to the program. Interviews will also be conducted with participating CCOs and clinics 9 months following the post-implementation interview to assess maintenance of the intervention. Interviews are conducted via videoconference and generally last 30–60 min. All qualitative interviews will be digitally recorded, professionally transcribed, uploaded to ATLAS.ti, and then analyzed by the research team using an immersion crystallization approach to identify salient findings . Findings from the interviews will inform program scale-up activities in aim 2 and will be used to develop content for study dissemination materials.
Periodic reflections and field notes
We will conduct monthly periodic reflection meetings with the practice facilitators and other members of the research team to track adaptations (to the intervention and to implementation strategies) and to understand barriers, facilitators, and contextual factors at the clinic and CCO levels . In addition, communication logs documenting interactions with CCOs and clinics will be maintained by each member of the research team, and clinic staff will enter notes into the REDCap database. Field notes and transcripts of periodic reflection sessions will be analyzed according to the immersion-crystallization approach on a quarterly basis throughout implementation .
To guide our evaluation of the implementation process, we will use elements of the Proctor Implementation Framework and RE-AIM [82, 83]. We will assess program implementation at the CCO and clinic levels using process measures (e.g., number of kits mailed/number anticipated, number eligible enrollees who receive any navigation). Reach is defined as the number of enrollees who received the intervention/number eligible enrollees, by component (mailed FIT or patient navigation). We will aggregate and report reach at the level of the clinic and CCO. We will also assess the characteristics of those reached and not reached. We will track adaptations to the program and implementation support using components of the FRAME framework for intervention adaptations and the FRAME-IS framework for implementation strategy adaptations [84, 85], focusing on adaptation type and the reason the adaptation was made. We will build on prior application of the FRAME framework by our team .
We will assess maintenance at the CCO, clinic, and enrollee levels. Maintenance will be defined as the proportion of CCOs and clinics that implemented the program in year 1 that also implemented it in year 2. For those CCOs and clinics that continue the program in the second year, we will descriptively compare the screening rates at year 2 to that of year 1. At the enrollee level, maintenance is defined as the proportion of enrollees who completed a FIT in year 1 also completed one in year 2 (with censoring for those who received a colonoscopy and thus are ineligible for FIT in year 2).
Aim 2: scale up the program to additional clinics serving rural and underserved patients using webinars, train-the-trainer workshops, and collaborative learning approaches
We will work with a national advisory board to develop a plan to scale up the program and disseminate training products to a national audience. Findings from the cluster-randomized study will be used to inform scale-up planning. Partnering regional and national organizations will receive a small stipend to participate in program training sessions to facilitate outreach and implementation of the mailed FIT and patient navigation intervention in 5–10 clinics they serve and to support program evaluation and tracking activities. The plan will likely include training sessions on mailed FIT outreach, patient navigation, and practice facilitation delivered to health systems, as well as to technical assistance and advocacy-organizations, using webinars, train-the-trainer workshops, and learning collaboratives informed by the Extension for Community Healthcare Outcomes (ECHO) format (Fig. 2). The 5-h multi-modal patient navigation training program developed for the main trial will be adapted, as needed, and delivered to support asynchronous and synchronous interactive learning. Two-day train-the-trainer workshops will be offered for individuals who provide technical assistance or quality improvement support. The project practice facilitators will be available by phone or email for organization staff who need real-time assistance implementing program components.
As part of the registration process for webinars, training workshops, and learning collaboratives, participants will be asked to complete a brief (15-min) survey. Survey questions will assess adoption of the program, program adaptations implemented or planned, and current clinical practices related to CRC screening and follow-up (e.g., current CRC screening practices and policies, screening test use/emphasis, and lab and vendor relationships, community resources). Participants who represent community organizations will be asked about their organization’s current CRC screening and follow-up facilitation activities and future plans. For all participants, we will gather demographic information (e.g., age, sex), professional role, affiliated organization name and location, and email address. We will ask permission to recontact participants in 6 months for a follow-up survey. Participants of multiple SMARTER CRC training events will only be asked to complete a single baseline survey.
Six months following the administration of the baseline survey, project staff will email respondents an invitation to complete a follow-up survey. This survey will ask respondents about their clinical practices related to CRC screening and follow-up, the extent to which implementation of the SMARTER CRC program is being planned or executed, planned or implemented adaptations to the program, and their participation in SMARTER CRC trainings or workshops.
Our plan to evaluate the scale-up trial will be developed with guidance from the national advisory board. We will track the number of health plan, clinic, and community organization staff who attend our train-the-trainer workshops, mailed-FIT workshops, and patient navigation workshops, ECHO-informed learning forums, and project-specific training events. We will report the number of individuals trained on each component by role (e.g., clinic staff, community organization representative, other). Using 6-month follow-up survey data, we will assess the number of community organizations whose staff have facilitated health plans or clinics to deliver the program and the number of health plans or clinics who have begun to implement each component of the program. Among those who have implemented the program, we will collect and report information about adaptations to the program and the reasons adaptations were made. We will assess determinants of dissemination success, using methods from systems science or configurational comparative methods [87, 88]. We will maintain project materials on a website and track the number of times the website is accessed and the number of times our implementation guide and templates are downloaded.
SMARTER CRC is a pragmatic study that will test the implementation, effectiveness, and scale-up of a multi-component mailed FIT and patient navigation program delivered to rural Medicaid and dual Medicaid-Medicare enrollees using a partnership among clinics, health plans, and vendors. We will test the program in three Medicaid health plans and 29 rural clinic units, then scale up the program by delivering tailored trainings and implementation support to health systems and organizations, assessing program adoption and adaptations. Our findings may have a profound impact on how to broadly scale evidence-based CRC screening programs in rural and frontier settings and may be particularly valuable in the context of COVID-19-related care disruptions and recent changes to the US Preventive Services Task Force CRC screening guidelines.
Availability of data and materials
Data sharing is not applicable to this article as no datasets were generated or analyzed during the current study.
- SMARTER CRC:
Screening More patients for CRC through Adapting and Refining Targeted Evidence-based Interventions in Rural settings
Fecal immunochemical test
Coordinated Care Organization
Eastern Oregon Coordinated Care Organization
Cascade Health Alliance
Intra-class correlation coefficient
Minimum detectable effect size
Extension for Community Healthcare Outcomes
Cronin KA, Lake AJ, Scott S, Sherman RL, Noone A-M, Howlader N, et al. Annual report to the nation on the status of cancer, part I: national cancer statistics. Cancer. 2018;124(13):2785–800.
American Cancer Society. Oregon Cancer Statistics at a glance. American Cancer Society; 2018. Available from: https://cancerstatisticscenter.cancer.org/#!/state/Oregon.
American Cancer Society. Colorectal cancer facts & figures 2017-2019. Atlanta: American Cancer Society; 2017.
Wiegering A, Ackermann S, Riegel J, Dietz UA, Gotze O, Germer CT, et al. Improved survival of patients with colon cancer detected by screening colonoscopy. Int J Color Dis. 2016;31(5):1039–45.
Siegel RL, Miller KD, Fedewa SA, Ahnen DJ, Meester RGS, Barzi A, et al. Colorectal cancer statistics, 2017. CA Cancer J Clin. 2017;67(3):177–93.
Joseph DA, King JB, Dowling NF, Thomas CC, Richardson LC. Vital Signs: Colorectal Cancer Screening Test Use — United States, 2018. MMWR Morb Mortal Wkly Rep. 2020;69:253–9. https://doi.org/10.15585/mmwr.mm6910a1.
Mannucci A, Zuppardo RA, Rosati R, Leo MD, Perea J, Cavestro GM. Colorectal cancer screening from 45 years of age: thesis, antithesis and synthesis. World J Gastroenterol. 2019;25(21):2565–80.
Imperiale TF, Kahi CJ, Rex DK. Lowering the starting age for colorectal cancer screening to 45 years: who will come…and should they? Clin Gastroenterol Hepatol. 2018;16(10):1541–4.
Anderson JC, Samadder JN. To screen or not to screen adults 45-49 years of age: that is the question. Am J Gastroenterol. 2018;113(12):1750–3.
Sabatino SA, White MC, Thompson TD, Klabunde CN. Cancer screening test use - United States, 2013. MMWR Morb Mortal Wkly Rep. 2015;64(17):464–8.
Henley SJ, Anderson RN, Thomas CC, Massetti GM, Peaker B, Richardson LC. Invasive cancer incidence, 2004-2013, and deaths, 2006-2015, in nonmetropolitan and metropolitan counties - United States. Morbid Morta Wkly Rep Surveill Summaries. 2017;66(14):1–13.
Cole AM, Jackson JE, Doescher M. Urban-rural disparities in colorectal cancer screening: cross-sectional analysis of 1998-2005 data from the centers for disease Control’s behavioral risk factor surveillance study. Cancer Med. 2012;1(3):350–6.
US Census Bureau. New census data show differences between urban and rural populations. American Community Survey, 2011–15. https://www.census.gov/newsroom/press-releases/2016/cb16-210.html?msclkid=c6ea34cbb6d811ec887f08f6576a5736. Accessed 6 Apr 2022.
Blake KD, Moss JL, Gaysynsky A, Srinivasan S, Croyle RT. Making the case for investment in rural cancer control: an analysis of rural cancer incidence, mortality, and funding trends. Cancer Epidemiol Biomark Prevent. 2017;26(7):992–7.
Lansdorp-Vogelaar I, Kuntz KM, Knudsen AB, van Ballegooijen M, Zauber AG, Jemal A. Contribution of screening and survival differences to racial disparities in colorectal cancer rates. Cancer Epidemiol Biomark Prev. 2012;21(5):728–36.
Services CfMM. Medicaid facts and figures Baltimore, MD2020. Available from: https://www.cms.gov/newsroom/fact-sheets/medicaid-facts-and-figures.
Oregon Health Authority. OHP data and reports. Oregon Health Authority; 2021. Available from: https://www.oregon.gov/oha/HSD/OHP/Pages/Reports.aspx.
Foutz J, Artiga S, Garfield R. The role of Medicaid in rural America. Menlo Park: The Henry J. Kaiser Family Foundation; 2017.
de Moor JS, Cohen RA, Shapiro JA, Nadel MR, Sabatino SA, Robin Yabroff K, et al. Colorectal cancer screening in the United States: trends from 2008 to 2015 and variation by health insurance coverage. Prev Med. 2018;112:199–206.
Davis MM, Renfro S, Pham R, Hassmiller Lich K, Shannon J, Coronado GD, et al. Geographic and population-level disparities in colorectal cancer testing: a multilevel analysis of Medicaid and commercial claims data. Prev Med. 2017;101:44–52.
Mojica CM, Bradley SM, Lind BK, Gu Y, Coronado GD, Davis MM. Initiation of colorectal cancer screening among Medicaid enrollees. Am J Prev Med. 2020;58(2):224–31.
Fitzgerald T, Lea C, Atluri P, Brinkley J, Zervos E. Insurance payer status and race explains much of the variability in colorectal cancer survival. J Cancer Ther. 2014;5:1223–33.
Andrew AS, Parker S, Anderson JC, Rees JR, Robinson C, Riddle B, et al. Risk factors for diagnosis of colorectal cancer at a late stage: a population-based study. J Gen Intern Med. 2018;33(12):2100–5.
Dougherty MK, Brenner AT, Crockett SD, Gupta S, Wheeler SB, Coker-Schwimmer M, et al. Evaluation of interventions intended to increase colorectal cancer screening rates in the United States: a systematic review and meta-analysis. JAMA Intern Med. 2018;178(12):1645–58.
Jager M, Demb J, Asghar A, Selby K, Mello EM, Heskett KM, et al. Mailed outreach is superior to usual care alone for colorectal cancer screening in the USA: a systematic review and meta-analysis. Dig Dis Sci. 2019;64(9):2489–96. https://doi.org/10.1007/s10620-019-05587-6. Epub 2019 Mar 26.
Issaka RB, Avila P, Whitaker E, Bent S, Somsouk M. Population health interventions to improve colorectal cancer screening by fecal immunochemical tests: a systematic review. Prev Med. 2019;118:113–21.
Davis MM, Freeman M, Shannon J, Coronado GD, Stange KC, Guise JM, et al. A systematic review of clinic and community intervention to increase fecal testing for colorectal cancer in rural and low-income populations in the United States - how, what and when? BMC Cancer. 2018;18(1):40.
Selby K, Baumgartner C, Levin TR, Doubeni CA, Zauber AG, Schottinger J, et al. Interventions to improve follow-up of positive results on fecal blood tests: a systematic review. Ann Intern Med. 2017;167(8):565–75.
Green BB, Anderson ML, Wang CY, Vernon SW, Chubak J, Meenan RT, et al. Results of nurse navigator follow-up after positive colorectal cancer screening test: a randomized trial. J Am Board Fam Med. 2014;27(6):789–95.
Raich PC, Whitley EM, Thorland W, Valverde P, Fairclough D. Denver patient navigation research program. Patient navigation improves cancer diagnostic resolution: an individually randomized clinical trial in an underserved population. Cancer Epidemiol Biomark Prev. 2012;21(10):1629–38.
Davis MM, Nambiar S, Mayorga ME, Sullivan E, Hicklin K, O'Leary MC, et al. Mailed FIT (fecal immunochemical test), navigation or patient reminders? Using microsimulation to inform selection of interventions to increase colorectal cancer screening in Medicaid enrollees. Prev Med. 2019;129S:105836. https://doi.org/10.1016/j.ypmed.2019.105836. Epub 2019 Oct 18.
Thompson JH, Davis MM, Leo MC, Schneider JL, Smith DH, Petrik AF, et al. Participatory research to advance colon cancer prevention (PROMPT): study protocol for a pragmatic trial. Contemp Clin Trials. 2018;67:11–5.
Coronado GD, Sanchez J, Petrik A, Kapka T, DeVoe J, Green B. Advantages of wordless instructions on how to complete a fecal immunochemical test: lessons from patient advisory council members of a federally qualified health center. J Cancer Educ. 2014;29(1):86–90.
Coronado GD, Vollmer WM, Petrik A, Taplin SH, Burdick TE, Meenan RT, et al. Strategies and opportunities to STOP colon cancer in priority populations: design of a cluster-randomized pragmatic trial. Contemp Clin Trials. 2014;38(2):344–9.
Coronado GD, Schneider JL, Sanchez JJ, Petrik AF, Green B. Reasons for non-response to a direct-mailed FIT kit program: lessons learned from a pragmatic colorectal-cancer screening study in a federally sponsored health center. Transl Behav Med. 2015;5(1):60–7.
Coronado GD, Retecki S, Schneider J, Taplin SH, Burdick T, Green BB. Recruiting community health centers into pragmatic research: findings from STOP CRC. Clin Trials. 2016;13(2):214–22.
Oluloro A, Petrik AF, Turner A, Kapka T, Rivelli J, Carney PA, et al. Timeliness of colonoscopy after abnormal fecal test results in a safety net practice. J Community Health. 2016;41(4):864–70.
Johnson KE, Neta G, Dember LM, Coronado GD, Suls J, Chambers DA, et al. Use of PRECIS ratings in the National Institutes of Health (NIH) health care systems research Collaboratory. Trials. 2016;17:32.
Coury J, Schneider JL, Rivelli JS, Petrik AF, Seibel E, D'Agostini B, et al. Applying the plan-do-study-act (PDSA) approach to a large pragmatic study involving safety net clinics. BMC Health Serv Res. 2017;17(1):411.
Coronado GD, Schneider JL, Petrik A, Rivelli J, Taplin S, Green BB. Implementation successes and challenges in participating in a pragmatic study to improve colon cancer screening: perspectives of health center leaders. Transl Behav Med. 2017;7(3):557–66.
Coronado GD, Rivelli JS, Fuoco MJ, Vollmer WM, Petrik AF, Keast E, et al. Effect of reminding patients to complete fecal immunochemical testing: a comparative effectiveness study of automated and live approaches. J Gen Intern Med. 2018;33(1):72–8.
Coronado GD, Petrik AF, Vollmer WM, Taplin SH, Keast EM, Fields S, et al. Effectiveness of a mailed colorectal cancer screening outreach program in community health clinics: the STOP CRC cluster randomized clinical trial. JAMA Intern Med. 2018;178(9):1174–81.
Thompson JH, Davis MM, Michaels L, Rivelli JS, Castillo ML, Younger BM, et al. Developing patient-refined messaging for a mailed colorectal cancer screening program in a Latino-based community health center. J Am Board Fam Med. 2019;32(3):307–17.
Coronado GD, Johnson ES, Leo MC, Schneider JL, Smith D, Mummadi R, et al. Patient randomized trial of a targeted navigation program to improve rates of follow-up colonoscopy in community health centers. Contemp Clin Trials. 2019;89:105920.
Gupta S, Coronado GD, Argenbright K, Brenner AT, Castañeda SF, Dominitz JA, et al. Mailed fecal immunochemical test outreach for colorectal cancer screening: summary of a Centers for Disease Control and Prevention-sponsored summit. CA Cancer J Clin. 2020;70(4):283–98. https://doi.org/10.3322/caac.21615 Epub 2020 Jun 25.
Wheeler SB, Davis MM. “Taking the bull by the horns”: four principles to align public health, primary care, and community efforts to improve rural cancer control. J Rural Health. 2017;33(4):345–9.
Ramanadhan S, Davis MM, Armstrong R, Baquero B, Ko LK, Leng JC, et al. Participatory implementation science to increase the impact of evidence-based cancer prevention and control. Cancer Causes Control. 2018;29(3):363–9.
Pham R, Cross S, Fernandez B, Corson K, Dillon K, Yackley C, et al. “Finding the right FIT”: rural patient preferences for fecal immunochemical test (FIT) characteristics. J Am Board Fam Med. 2017;30(5):632–44.
Davis MM, Lindberg P, Cross S, Lowe S, Gunn R, Dillon K. Aligning systems science and community-based participatory research: a case example of the community health advocacy and research Alliance (CHARA). J Clin Transl Sci. 2018;2(5):280–8.
Dillon KLP, Davis MM, editors. Aligning research with action in the Columbia Gorge – the community health advocacy and research Alliance (CHARA). Lanham: Lexington Books of Rowman & Littlefield; 2019.
Coronado GD, Petrik AF, Bartelmann SE, Coyner LA, Coury J. Health policy to promote colorectal cancer screening: improving access and aligning federal and state incentives. Clin Res (Alex). 2015;29(1):50–5.
Curtis LH, Dember LM, Vazquez MA, Murray D, DeBar L, Staman KL, et al. Addressing guideline and policy changes during pragmatic clinical trials. Clin Trials. 2019;16(4):431–7.
Burki TK. USPSTF: colorectal cancer screening in the US from 45 years. Lancet Gastroenterol Hepatol. 2021;6(7):530.
Davidson KW, Barry MJ, Mangione CM, Cabana M, Caughey AB, Davis EM, et al. Screening for colorectal cancer: US preventive services task force recommendation statement. Jama. 2021;325(19):1965–77.
Coury JK, Schneider JL, Green BB, Baldwin LM, Petrik AF, Rivelli JS, et al. Two Medicaid health plans’ models and motivations for improving colorectal cancer screening rates. Transl Behav Med. 2020;10(1):68–77. https://doi.org/10.1093/tbm/iby094.
Coronado GD, Green BB, West II, Schwartz MR, Coury JK, Vollmer WM, et al. Direct-to-member mailed colorectal cancer screening outreach for Medicaid and Medicare enrollees: implementation and effectiveness outcomes from the BeneFIT study. Cancer. 2020;126(3):540–8.
Green BB, West II, Baldwin LM, Schwartz MR, Coury J, Coronado GD. Challenges in reaching Medicaid and Medicare enrollees in a mailed fecal immunochemical test program. J Community Health. 2020;45(5):916–21. https://doi.org/10.1007/s10900-020-00809-9.
Oregon Office of Rural Health. Oregon Office of Rural Health Geographic Definitions 2021 [Available from: https://www.ohsu.edu/oregon-office-of-rural-health/about-rural-and-frontier-data.
USDA Economic Research Service. Rural-Urban Commuting Area Codes 2020 [Available from: https://www.ers.usda.gov/data-products/rural-urban-commuting-area-codes.aspx.
University of Washington WWAMI Rural Health Research Center. Rural-Urban Commuting Area (RUCA) codes 2021 [Available from: https://familymedicine.uw.edu/rhrc/ruca/.
Rice K, Gressard L, DeGroff A, Gersten J, Robie J, Leadbetter S, et al. Increasing colonoscopy screening in disparate populations: results from an evaluation of patient navigation in the New Hampshire colorectal cancer screening program. Cancer. 2017;123:3356–66.
Coronado GD, Rawlings AM, Petrik AF, Slaughter M, Johnson ES, Hannon PA, et al. Precision patient navigation to improve rates of follow-up colonoscopy, an individual randomized effectiveness trial. Cancer Epidemiol Biomarkers Prev. 2021;30(12):2327–33. https://doi.org/10.1158/1055-9965.EPI-20-1793. Epub 2021 Sep 28.
Norman N, Bennett C, Cowart S, Felzien M, Flores M, Flores R, et al. Boot camp translation: a method for building a community of solution. J Am Board Fam Med. 2013;26(3):254–63.
Westfall JM, Zittleman L, Felzien M, Norman N, Tamez M, Backlund-Jarquin P, et al. Reinventing the wheel of medical evidence: how the boot camp translation process is making gains. Health Aff (Millwood). 2016;35(4):613–8. https://doi.org/10.1377/hlthaff.2015.1648.
Nagykaldi Z, Mold JW, Robinson A, Niebauer L, Ford A. Practice facilitators and practice-based research networks. J Am Board Fam Med. 2006;19(5):506–10.
Agency for Healthcare Research and Quality. Practice facilitation. 2018. Available from: https://pcmh.ahrq.gov/page/practice-facilitation.
Baskerville NB, Liddy C, Hogg W. Systematic review and meta-analysis of practice facilitation within primary care settings. Ann Fam Med. 2012;10(1):63–74.
Wang A, Pollack T, Kadziel LA, Ross SM, McHugh M, Jordan N, et al. Impact of practice facilitation in primary care on chronic disease care processes and outcomes: a systematic review. J Gen Intern Med. 2018;33(11):1968–77.
Nagykaldi Z, Mold JW, Aspy CB. Practice facilitators: a review of the literature. Fam Med. 2005;37(8):581–8.
Harvey G, Kitson A. PARIHS revisited: from heuristic to integrated framework for the successful implementation of knowledge into practice. Implement Sci. 2016;11(1):33.
Harvey G, Kitson A. Implementing evidence-based practice in healthcare: a facilitation guide. New York: Routledge; 2015.
Harvey G, Kitson A. PARIHS revisited: from heuristic to integrated framework for the successful implementation of knowledge into practice. Implement Sci. 2016;11:33.
Kirchner JE, Smith JL, Powell BJ, Waltz TJ, Proctor EK. Getting a clinical innovation into practice: an introduction to implementation strategies. Psychiatry Res. 2020;283:112467.
von Hippel PT. Regression with missing Ys: an improved strategy for analyzing multiply imputed data. Sociol Methodol. 2007;37:83–117.
Allison P, editor. In: Handling missing data by maximum likelihood. SAS global forum: statistics and data analysis; 2012.
Raudenbush S, Bryk A. Hierarchical linear models: applications and data analysis methods. Thousand Oaks: Sage Publications; 2002.
Demidenko E. Sample size determination for logistic regression revisited. Stat Med. 2007;26(18):3385–97.
Hsieh FY, Bloch DA, Larsen MD. A simple method of sample size calculation for linear and logistic regression. Stat Med. 1998;17(14):1623–34.
NCSS L. PASS 15 Power analysis and sample size software Kaysville, Utah, USA. 2017. https://www.ncss.com/software/pass/. Accessed 6 Apr 2022.
Miller WL, Crabtree BF. Qualitative analysis: how to begin making sense. Fam Pract Res J. 1994;14(3):289–97.
Finley EP, Huynh AK, Farmer MM, Bean-Mayberry B, Moin T, Oishi SM, et al. Periodic reflections: a method of guided discussions for documenting implementation phenomena. BMC Med Res Methodol. 2018;18(1):153.
Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Admin Pol Ment Health. 2011;38(2):65–76.
Glasgow RE, Klesges LM, Dzewaltowski DA, Estabrooks PA, Vogt TM. Evaluating the impact of health promotion programs: using the RE-AIM framework to form summary measures for decision making involving complex issues. Health Educ Res. 2006;21(5):688–94.
Wiltsey Stirman S, Baumann AA, Miller CJ. The FRAME: an expanded framework for reporting adaptations and modifications to evidence-based interventions. Implement Sci. 2019;14(1):58. https://doi.org/10.1186/s13012-019-0898-y.
Miller CJ, Barnett ML, Baumann AA, Gutner CA, Wiltsey-Stirman S. The FRAME-IS: a framework for documenting modifications to implementation strategies in healthcare. Implement Sci. 2021;16(1):36.
Coronado GD, Schneider JL, Green BB, Coury JK, Schwartz MR, Kulkarni-Sharma Y, et al. Health plan adaptations to a mailed outreach program for colorectal cancer screening among Medicaid and Medicare enrollees: the BeneFIT study. Implement Sci. 2020;15(1):77. https://doi.org/10.1186/s13012-020-01037-4.
Petrik AF, Green B, Schneider J, Miech EJ, Coury J, Retecki S, et al. Factors influencing implementation of a colorectal cancer screening improvement program in community health centers: an applied use of configurational comparative methods. J Gen Intern Med. 2020;26(10):020–06186.
Coury J ME, Styer P, Petrik AF, Coates KE, Green BB, Baldwin LM, Shapiro JA, Coronado G. . What’s the “secret sauce”? How implementation variation affects the success of colorectal cancer screening outreach. Implement Sci Commun. 2021;2(1):5. https://doi.org/10.1186/s43058-020-00104-7.
The authors would like to acknowledge the SMARTER CRC advisory board and our CCO partners for their input and collaborative efforts.
Research reported in this publication was supported by the National Cancer Institute of the National Institutes of Health under Award Number UG3CA244298. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health. Melinda Davis was partially supported by an NCI K07 award (1K07CA211971-01A1).
Ethics approval and consent to participate
The study protocol was reviewed and approved by the Institutional Review Board at Oregon Health & Science University and was granted a waiver of informed consent, given minimal risks to patients.
Consent for publication
All authors have reviewed a final version of this manuscript and provide consent for its publication.
From 2020 to the present, Dr. Coronado serves as a Scientific Advisor on contracts through the Center for Health Research for Exact Sciences and Guardant Health. She also serves as a member of the Board of Scientific Advisors for the National Cancer Institute (NCI).
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Coronado, G.D., Leo, M.C., Ramsey, K. et al. Mailed fecal testing and patient navigation versus usual care to improve rates of colorectal cancer screening and follow-up colonoscopy in rural Medicaid enrollees: a cluster-randomized controlled trial. Implement Sci Commun 3, 42 (2022). https://doi.org/10.1186/s43058-022-00285-3
- Colorectal cancer screening
- Mailed FIT outreach
- Fecal test
- Fecal immunochemical test (FIT)
- Follow-up colonoscopy
- Implementation science
- Primary care