Skip to main content
Download PDF
Download ePub

Study protocol: A stepped-wedge, cluster-randomized trial of the effectiveness of a deliberative loop in identifying implementation strategies for the adoption of a dental sealant guideline in dental clinics

Implementation Science Communications volume 2, Article number: 96 (2021) Cite this article

Abstract

Background

The American Dental Association (ADA) recommends dental providers apply dental sealants to the occlusal surfaces of permanent molars for the prevention or treatment of non-cavitated dental caries. Despite the evidence-based support for this guideline, adherence among general dentists is low, ranging from less than 5 to 38.5%. Thus, an evidence-to-practice gap exists, and it is unclear which implementation strategies would best support providers in adopting and implementing the evidence-based practice. One potential approach to selecting and tailoring implementation strategies is a deliberative loop process, a stakeholder-engaged approach to decision-making. This trial aims to test the acceptability, feasibility, and effectiveness of using a deliberative loop intervention with stakeholders (i.e., providers and staff) to enable managers to select implementation strategies that facilitate the adoption of an evidence-based dental practice.

Methods

Sixteen dental clinics within Kaiser Permanente Northwest Dental will be cluster randomized to determine the timing of receiving the intervention in this stepped-wedge trial. In the three-part deliberative loop intervention, clinic stakeholders engage in the following activities: (1) receive background information, (2) participate in facilitated small-group discussions designed to promote learning from each other’s lived experiences and develop informed opinions about effective clinic-level implementation strategies, and (3) share their informed opinions with clinic leaders, who may then choose to select and deploy implementation strategies based on the stakeholders’ informed opinions. The primary outcome of Reach will be defined as patient-level receipt of guideline-concordant care. Secondary outcomes will include the cost-effectiveness, acceptability, and feasibility of the deliberative loop process. Implementation strategies deployed will be catalogued over time.

Discussion

These results will establish the extent to which the deliberative loop process can help leaders select and tailor implementation strategies with the goal of improving guideline-concordant dental care.

Trial registration

This project is registered at ClinicalTrials.gov with ID NCT04682730. The trial was first registered on 12/18/2020. https://clinicaltrials.gov/ct2/show/NCT04682730

Background

Non-cavitated occlusal carious lesions (NCCLs), also known as incipient caries or white spot lesions, are lesions in which bacteria have compromised some but not all of the enamel (i.e., outermost layer) on the occlusal surface of the tooth. If left untreated, the bacteria may continue to harm the tooth structure and the lesion may continue to progress to the point at which a filling is needed. Receiving a filling involves having healthy tooth structure removed, which increases the risk of root infection, tooth fracture, and tooth loss, and the financial cost of managing these consequences [1, 2].

The most effective approach to both preventing and arresting the progression of NCCLs is dental sealants [3]. The effectiveness of sealants far exceeds the benefits provided by commonly used interventions such as topical fluoride applications and professional dental cleanings [3]. Despite the evidence base supporting and American Dental Association (ADA) guidelines recommending the use of dental sealants [4], provider compliance with the guideline remains low. Among general dentists, guideline compliance ranges from less than 5 to 38.5% [5, 6]. In a descriptive study of the dental clinics participating in the present intervention, although almost 95% of the general and pediatric dentists reported using sealants to prevent caries, only 51% reported using sealants to arrest NCCLs [7]. Furthermore, of the approaches endorsed, using sealants to arrest NCCLs was the approach least frequently adopted. Dentists reported using less effective approaches such as providing office remineralization (67%), prescribing a behavioral intervention (66%), indicating a “watch” in the chart (58%), and placing a restoration (58%). Consistent adherence to the guideline will improve NCCL treatment outcomes and may lead to reduced treatment cost.

The deliberative loop process is a novel implementation intervention that may be well-suited to helping large group dental practices select and tailor implementation strategies to address implementation barriers. Implementation strategies are “methods or techniques used to enhance adoption, implementation, and sustainability of a clinical program or practice” [8]. Selecting and tailoring implementation strategies is a challenge that is being addressed in several ways by implementation scientists [9]. However, to date, the deliberative loop process has not been studied as a method to assist leaders in selecting and tailoring strategies. The deliberative loop process is a three-step approach entailing educating stakeholders, engaging stakeholders in facilitated conversations about strategies, and informing leaders about strategies stakeholders recommend [10]. This approach is both promising and unique because it draws from the collective wisdom of those affected by the policy and engages differences in perspective as a resource.

The objective of the Dissemination and Implementation of Sealant Guidelines in Organizations (DISGO) study is to determine whether introducing the deliberative loop process to an organization enables the organization to improve adherence to a guideline based on the ADA’s pit-and-fissure dental sealant guideline. This protocol paper outlines the methods for a trial evaluating whether the deliberative loop process increases guideline-concordant care. We hypothesize that introducing the deliberative loop process will enable providers and staff to develop informed understandings of the barriers to implementing the guideline, identify potential implementation strategies to overcome the barriers, and share their opinions with leadership. Using the feedback from providers (dentists, dental hygienists, and expanded function dental assistants) and staff, leadership (decision makers including upper and middle managers) will be able to identify and adopt implementation strategies, which will lead to providers placing more sealants. In addition, we are evaluating the cost-effectiveness of the deliberative loop intervention.

Methods

Conceptual model

Figure 1 illustrates our conceptual model, derived from our formative work with stakeholders to identify barriers and facilitators [11]. The determinants are framed using the COM-B model of behavior [12], which posits that an agent’s behavior changes when that agent has sufficient capability, opportunity, and motivation to change. We found that at the clinic level, the main barrier is one of capability. The organization’s current implementation strategy relies on the passive dissemination of guidelines through formal and informal staff meetings, continuing education, and clinic champions. At the provider and staff level, the main capability barrier is that individual providers and staff members lack a complete understanding of the barriers to implementing the guideline, and thus, they may be unable to recommend potential implementation strategies to overcome the barriers (i.e., informed opinion). Providers’ and staff’s main opportunity barrier is that they may lack the opportunity to share informed recommendations for implementation interventions with leadership (i.e., voice). An important motivational barrier for many dentists is the conflict in clinical decision making between dentist autonomy and evidence-based practice. In addition to barriers, we also identified facilitators. At the clinic level, the main opportunity facilitator is the existence of the Unit-Based Team meeting, in which all clinic providers and staff come together to develop solutions to problems. The main motivation facilitator is the practice’s commitment to evidence-based practice.

Fig. 1
figure 1

Conceptual model. Note. Blue denotes barriers targeted by the deliberative process intervention, gold denotes facilitators, and red denotes mechanisms proposed to be influenced by the intervention

Full size image

Study setting

The Kaiser Permanente Dental (KPD) program is part of the Kaiser Permanente Northwest (KPNW) integrated health care system and provides comprehensive, pre-paid dental care services to over 250,000 dental plan members in Oregon and southwest Washington. The organization employs 635 administrative and clinical support staff across its 21 dental offices. With the exception of administrative and managerial staff, all front-line staff are unionized. Permanente Dental Associates (PDA) is a professional corporation of 150 associate and shareholder dentists and denturists that provides comprehensive care to KPD members. KPD insurance plans offer an array of different insurance benefits to employers and individuals. Across all KPD plans, there are no age or frequency limitations for dental sealant placement, which reduces the financial barrier for patients when a dental sealant is indicated. In addition, KPD is part of Health Share of Oregon (www.healthshareoregon.org), a large coordinated care organization that services the state’s Medicaid population in the tri-county Portland metropolitan area.

Kaiser Permanente has a long history of engaging with unionized workforces. The organization uses a labor management partnership in many of its operational initiatives. At the level of the dental clinic, this partnership is manifested in a self-directed decision-making structure, called the Unit-Based Team (UBT), and is co-led by a manager, a staff member, and a dentist. The team includes all the members of the natural work group, which enables them to build on the diverse perspectives and expertise of the team members. The purpose of the UBT is to address issues affecting performance or the work environment. For example, if a clinic wanted to increase patient satisfaction, the team might decide to provide patients with spa-like amenities, such as eye masks and heated blankets. The UBT meetings are clinic-based and occur monthly, typically during a lunch hour. All employees present at a clinic on that day, including front-of-the-house staff, attend and participate. If information directly related to patient care or employment is discussed at the UBT meeting, the clinic manager may send that information to employees who were not present. The organizational structure provides substantial clinic-level autonomy to organize care to fit different patient panels and office practice styles.

Study design and recruitment

The DISGO study uses a cluster-randomized, stepped-wedge design to evaluate the effectiveness and cost-effectiveness of the deliberative loop intervention compared with a non-intervention period. To form the clusters, we used clinic volume (annual visits) and provider (general and pediatric dentists and dental hygienists) staffing FTEs during 2019 (before COVID-19) to categorize 16 of 21 dental offices by size as small, medium, or large. We excluded five offices that were reorganized in 2020 to focus on urgent care. To compose a cluster, we randomly selected one clinic from each of the three size categories. One remaining medium sized clinic serves as the vanguard clinic. The intervention was launched in the vanguard clinic in March 2021 and was followed by the first cluster in April. Clusters will roll out in five 6-week periods, for a total of 30 weeks. This rollout schedule will provide 98 non-intervention months of data and 101 intervention months (Table 1) for evaluation during a 12-month evaluation period from January 1 to December 31, 2021 (Figs. 2 and 3). The study adheres to the SPIRIT guideline [13, 14].

Table 1 Distribution of clinic-months over the study period
Full size table
Fig. 2
figure 2

Schedule of exposure of clinics by cluster to the intervention

Full size image
Fig. 3
figure 3

CONSORT flow diagram

Full size image

All persons employed by KPD or PDA and who work in the 16 randomized Kaiser Permanente dental clinics, part- and full-time, will be eligible to participate in the study. This includes both service providers (dentists, dental hygienists, and expanded function dentist assistants) and front-of-the-house staff. No patients are participating in this study.

Power

Power was calculated using the “stepped wedge” package in Stata 16 [15], based on the approach developed by Hussey and Hughes [16]. Our null hypothesis is that providers’ rates of placing or treatment planning sealants for occlusal NCCLs will not differ between the non-intervention and intervention periods. Our alternative hypothesis is that providers’ rates of placing or treatment planning sealants for occlusal NCCLs will increase following the intervention. We assumed a Type I error of 0.05 and a 3% rate of placing or treatment planning sealants in the non-intervention period and a 10% rate in the intervention period, which is an increase that is similar to that seen in similar interventions [17]. Scenarios were calculated using intraclass correlations of 0.01, 0.1, and 0.25 and n=50 as the average number of providers per clinic in a conservative scenario and n=60 in a more realistic scenario using provider counts from participating clinics. Randomizing 15 clinics along with 1 vanguard clinic using a stepped-wedge approach with these assumptions and under these scenarios, we will have at least 80% power and close to 100%.

The deliberative loop intervention

The deliberative loop intervention is designed to address barriers while building on facilitators. The clinic-level implementation intervention is to introduce to the clinics the deliberative loop process for identifying clinic- and provider-level implementation strategies. There are three steps to a deliberative loop. In the first step, during an introduction to the process presented via a prerecorded PowerPoint presentation delivered over Microsoft Teams, stakeholders (i.e., providers and staff) receive background information designed to include the full range of perspectives on the issue. They also receive a workbook via email with information about barriers and possible implementation strategies (Fig. 4).

Fig. 4
figure 4

Example of information provided in the workbook for one implementation strategy. Note. (a) A rating of the level of evidence supporting the strategy. (b) A brief description of the strategy. (c) An anchor to the barrier(s) the strategy could address. (d)Who delivers the strategy. (e) Who engages in the strategy. (f) A summary of existing assets at KPD relevant to the strategy. (g) A unique badge for the strategy

Full size image

In the second step, about a month after receiving the background information, the stakeholders participate in an online facilitated small group discussion (i.e., deliberative forum) using the Common Ground for Action platform (Kettering Foundation and the National Issues Forums Institute, Dayton, Ohio), in which they share their lived experience and hear the lived experience of their fellow stakeholders. Groups are designed to include stakeholders representing the range of roles in the clinic and thus perspectives on the issue being addressed. Achieving consensus is not a goal of the process; rather, the goal is to expand stakeholders’ understanding of the issue.

In the third step, immediately following the deliberative forum, the stakeholders complete a survey accessed via Qualtrics (Seattle, Washington and Provo, Utah) sharing their now-informed opinion about the implementation strategies they recommend. Two weeks following the deliberative forum, the results of the survey are summarized in a report and shared with leadership, who selects the implementation strategy. Thus, the product that results from the deliberative loop process is a set of recommendations from stakeholders for clinic- and provider-level implementation strategies for leadership to consider. Due to COVID-19 and the restrictions around in-person meetings, all meetings are conducted online from workstations in the dental offices.

Using the Theoretical Domains Framework [18], the deliberative loop intervention engages the following intervention functions (see Table 2): environmental restructuring, education, and training [18, 19]. The specific interventions targeting these functions include restructuring the social environment, instruction on how to perform the behavior, behavioral practice/rehearsal, and behavioral experiments [19]. The environmental restructuring comprises the introduction of the deliberative loop process into the organization’s approach to implementation. Instruction on how to perform the behavior occurs when the stakeholders learn about the deliberative loop process during the introductory session. The behavioral practice/rehearsal occurs when the stakeholders experience the three steps of the deliberative loop process. And the behavioral experiment occurs when they apply the deliberative loop process to the problem of low adherence to the pit-and-fissure dental sealant guideline. Because the implementation strategy for guideline adherence will be identified by leadership following the deliberative loop process, we are unable to categorize the strategy.

Table 2 Relationships among COM-B constructs, barriers, facilitators, intervention functions, behavior change techniques, and modes of delivery
Full size table

Measures

Table 3 outlines the measures, sources, and timing for each construct in the conceptual model and study.

Table 3 Theoretical constructs, measures, data sources, and timing of data collection
Full size table

Primary outcome: provider sealing behavior

The primary outcome, a measure of Reach, the extent to which a program attracts its intended audience [20], will be calculated for each clinic and for each dentist as the difference in the rates of sealant application for occlusal E1/E2 lesions between the intervention and non-intervention periods. This represents patient-level receipt of guideline-concordant care. Providers’ rates of sealant application for occlusal E1/E2 lesions will be extracted from the electronic health record.

Secondary outcome: cost and cost-effectiveness

The secondary outcome, a measure of implementation, is the cost and cost-effectiveness of the deliberative loop intervention. We will estimate total program costs, total costs per clinic, and total costs per member per month (PMPM) for the non-intervention and intervention periods. We will assess the cost-effectiveness of the deliberative loop intervention by estimating an incremental cost-effectiveness ratio (ICER) to quantify the additional intervention costs associated with increasing the sealant placement rates during the intervention period compared with usual care during the non-intervention period.

Adoption

Project staff will keep records of the number of introductory sessions and deliberative forums delivered to the clinics and the percentage of expected stakeholders who attended the sessions. Project staff will count the number of surveys submitted and compare the count against the clinic census provided by the Clinic Manager.

Fidelity

Because the introductory session is delivered via a prerecorded video, the workbook is sent to all clinic staff via email, and the link to the post-session survey is embedded in the deliberative forum online platform, assessment of fidelity of the deliberative loop intervention will focus on the deliberative forum, which will be evaluated in two ways, and the report provided to leadership.

First, all deliberative forums will generate a written transcript. Following each deliberative forum, we will review the transcripts using four codes to assess how well the facilitator adhered to the protocol. An example of one of the codes is as follows: “Elicits viewpoints from every participant/ensures that no one dominates the discussion: Encourages equal participation of each participant, makes room for participants to share their opinions.” In addition, we will review the transcripts using two codes to assess whether the stakeholders participated in the facilitated discussions. An example of one of the codes is as follows: “Unique contributions that include statement of opinion, statement of reason.”

Second, included in the post-session survey are two items assessing fidelity (e.g., “Today’s discussion caused me to consider points of view that I had not previously considered”) scored on a 5-point Likert-type scale ranging from “Strongly Disagree” to “Strongly Agree” together with a free response box for comments and suggestions. If we determine from the fidelity assessment that the training for the facilitators could be improved, we will change their training as indicated.

To determine whether reports summarizing the stakeholders’ informed opinions are shared with leadership, project staff will track the percentage of reports the study team delivers to leadership.

Acceptability

We will assess the acceptability of the intervention to both leadership and stakeholders. Following the final deliberative forum, we will assess KPD’s and PDA leadership’s perceptions of acceptability and feasibility of the deliberative loop process. We will share results from our cost and cost-effectiveness analyses with the clinic, KPD, and PDA management teams and have them rate the acceptability and feasibility of the deliberative loop on 5-point Likert scales.

Immediately following each clinic’s deliberative forum on the post-session survey, we will obtain from stakeholders measures of the acceptability of the deliberative forum and a regular UBT meeting. Stakeholders will rate all questions on a 5-point Likert-type scale ranging from “Strongly Disagree” to “Strongly Agree” and may add comments and suggestions in a free response box. We will assess the acceptability of the workbook providing background information via three items (e.g., “I found the written materials clear and easy to understand”). We will assess the helpfulness (three items; e.g., “I found the group discussions informative”) and relevance (five items; e.g., “Today’s discussion would be a good way for us to explore other issues”) of the group discussions. We will assess stakeholders’ comfort using the online platform.

Mechanisms

We propose that the deliberative loop intervention will change stakeholder’ opinions and their perceptions of voice. To measure change in stakeholders’ opinions, we will quantify the absolute change in stakeholders’ rankings of their top five strategies (out of a total of eight possible) made at the beginning and end of the deliberative forum. For options that are not ranked at either the beginning or end of the forum, we will assign them a value of 6. Thus, for example, if an option was not ranked at the beginning of the forum but then ranked 3 at the end of the forum, we will calculate the change as 3.

We will measure stakeholders’ perceptions of voice, which we define as having the opportunity to share one’s views, in three ways. First, voice will be measured using the Promotive and Prohibitive Voice scales [21]. Both Promotive Voice and Prohibitive Voice will be assessed immediately following the deliberative forum, via the post-session survey. Stakeholders will complete the scales first as they characterize the deliberative forum and second as they characterize past UBT meetings. Each scale has five items and is scored on a 5-point Likert-type scale ranging from “Strongly Disagree” to “Strongly Agree.” Six-week test-retest reliability has been shown to be 0.42 for Promotive Voice and 0.44 for Prohibitive Voice. In validation studies, these scales have been shown to have convergent and discriminant validity. Confirmatory analysis that also included measures of psychological safety, felt obligation for constructive change, and organization-based self-esteem demonstrated that a five-factor model in which each scale loaded on a separate factor fit best.

Second, the post-session survey will also include questions addressing the stakeholders’ perceptions of leadership responsiveness to feedback in the past year (three questions) and anticipated responsiveness to the feedback from the forum. These questions are scored on a 5-point Likert-type scale ranging from “Strongly Disagree” to “Strongly Agree” and are followed by a free response box for comments and suggestions.

Third, we will review the transcripts from the deliberative forums using six codes to assess stakeholder voice. An example of one of the codes is as follows: “Suggest new behaviors which are beneficial to my clinic.”

Exploratory measures

To learn more about any effects of the deliberative loop process, project staff will track the percentage of clinics selecting an implementation strategy and deploying their selected implementation strategy. Either the Clinic Manager or a champion identified by the Clinic Manager will track any strategies implemented using a tracking sheet designed for the study and will share the tracking sheet with the study team quarterly. In addition, 3 months after a clinic’s deliberative forum, the Clinic Manager will identify 1–2 clinic staff to participate in a semi-structured interview. The tracking sheets will serve as the basis for the interview, which is designed to obtain additional information about the implementation process. An example of one of the interview questions is as follows: “To your knowledge, was there any follow-up from leadership about possible implementation of strategies to improve sealant placement rates?”

Data analysis

Primary outcome analysis

The non- and intervention sealant rates and their difference will be treated as continuous variables. Using an intention to treat approach, we will use multi-level modeling to compare the sealant rates between the intervention and non-intervention periods. We will use generalized linear models or generalized estimating equations to model the intervention effect while nesting sealant outcomes within provider and provider within clinic and accounting for secular trends, if necessary. In this scenario, our outcome will be whether an eligible E1/E2 lesion was sealed, and we will examine the clinic-level effects of the intervention [22].

The PDA guideline includes children, adolescents, and adults. To enable comparison with studies following the ADA guideline, in addition to analyzing lesions occurring in children, adolescents, and adults, we will also conduct analyses for lesions occurring in just children and adolescents. Per the ADA, we will define “children and adolescents” as persons ranging in age from 6 through 17 years old.

Secondary outcome analysis

We will use Program Cost Analysis [23] to quantify total program costs, total costs per clinic, and total costs per member per month (PMPM) for the non-intervention and intervention periods. We will work with KPD and PDA staff to develop realistic real-world estimates of the staff time and resources used to develop and print a workbook, including staff time that would be needed to conduct an appropriate literature review, collect and assess health records data, develop clinic monitoring processes, and prepare, print, and distribute a completed workbook. Staff time for meetings, workbook review, the deliberative forum, post-forum survey, and relevant clinic follow-up meetings will be documented, and average labor costs, by profession type, will be assigned. Costs for selected implementation strategies (equipment, trainings, CE, staff time) will be obtained from clinic managers and other KPD and PDA staff during the implementation period. Treatment costs (procedure costs based on local market paid claims) for eligible tooth surfaces and patient-paid costs will be obtained from the electronic health records. All costs will be reported in 2021 dollars.

An incremental cost-effectiveness ratio (ICER) will be estimated using the following formula: (mTCi − mTCc) / ( mSPRi − mSPRc), where mTCi and mTCc represent the mean total intervention costs for clinics during the non-intervention and intervention periods, including NCCL treatment costs, and mSPRi and mSPRc represent the mean cumulative sealant placement rates for eligible teeth among patients with a routine care visit over the 12-month evaluation period for each clinic. We will calculate ICERs and bootstrapped confidence intervals methods based on the data [24]. We expect differences in both costs and sealant placement rates to be unequivocally positive. If, however, the results are equivocal, we will conduct simulation modeling using bootstrapping and incremental net benefit approaches to assess the effects of model input variability on outcomes [25,26,27]. Incremental net benefit analysis allows adjustment for known statistical issues associated with confidence intervals (CIs) for equivocal ICERs by estimating CIs around the organizations (payer’s) willingness to pay for the intervention.

Exploratory analysis of putative mediators

We will examine whether having an informed opinion and perceptions of voice mediate the relationship between exposure to the intervention and the use of sealants on NCCL. We will use causal inference methods [28] that have been extended to allow for multiple mediators, as well as exposure-mediator and mediator-mediator interactions. This framework includes both regression-based approaches and approaches based on inverse probability weighting. We will default to the regression-based approach. If model fitting issues are present, we will use the inverse probability weighting approach.

Additional analyses

We will use descriptive analyses to characterize adoption, fidelity, and acceptability. In addition, we will use descriptive statistics to characterize clinics’ selection and deployment of implementation strategies.

Discussion

The purpose of this study is to examine whether introducing the deliberative loop process to an organization enables the clinics within the organization to identify implementation strategies for the organization’s pit-and-fissure dental sealant guideline. The deliberative loop process is a decision-making process that draws on the lived experience of stakeholders and engages difference as a resource. This study will determine whether the deliberative loop process assists clinic leadership at an organization that values and practices shared decision-making in selecting implementation strategies that improve provider adherence to a guideline. There is little information about effective implementation processes for large group dental practices. Our study may be the first to introduce a process that includes both top-down and bottom-up elements. The top-down element supports clinic leadership in their decision-making powers. The bottom-up element elicits the desirability to providers and staff of a range of clinic-level implementation interventions and provides this information to clinic leadership.

Strengths of the study include being guided by theory, having an intervention that addresses identified barriers, and receiving strong support from KPD leadership. With this support, we were able to randomize clinics to steps and optimize the intervention to the needs of the clinics. There are limitations that must be considered, as well. The intervention comprises three components. Because all clinics are receiving all components, should the intervention be successful, we will not have information about the components that contribute to that success. Additionally, because we are conducting this study in the context of one organization with its culture of shared decision-making, should the intervention be successful, we will not be able to determine the cultural parameters that contribute to that success. Finally, the measures characterizing perceptions of voice during the deliberative forum and UBT meetings are both taken following the deliberative forum. Although the retrospective measure of voice during UBT meetings could lack validity and thus bias the results, we believe that the measure could be more valid because the stakeholders have an alternative, the deliberative forum, to use as a comparison. This study will not be able to assess this possibility, however.

Conclusion

One aspect of an implementation process involves selecting the implementation strategy to deploy. This study seeks to evaluate the effectiveness of the deliberative loop process, in which leaders select implementation strategies (i.e., top down) informed by the opinions of those who will be affected by the policy (i.e., bottom up), to increase provider adherence to the pit-and-fissure dental sealant guideline. The results of this study will be of interest to any organization considering how best to select implementation strategies to deploy and to the field of implementation science as a whole.

Availability of data and materials

Data sharing is not applicable to this article as no datasets were generated or analyzed during the current study.

Abbreviations

ADA:

American Dental Association

CEA:

Cost-effectiveness analysis

CI:

Confidence interval

DISGO:

Dissemination and Implementation of Sealant Guidelines in Organizations

E1/E2:

Enamel lesions

EHR:

Electronic health record

ICER:

Incremental cost-effectiveness ratio

KPD:

Kaiser Permanente Dental

mSPRi:

Mean cumulative sealant placement rates for eligible teeth among patients with a routine care visit at clinics following the intervention

mSPRc:

Mean cumulative sealant placement rates for eligible teeth among patients with a routine care visit at clinics before the intervention

mTCi:

Mean total intervention costs at clinics following the intervention

mTCc:

Mean total intervention costs at clinics before the intervention

NCCL:

Non-cavitated carious lesion

PDA:

Permanente Dental Associates

PMPM:

Per member per month

UBT:

Unit-Based Team

References

  1. Brantley CF, Bader JD, Shugars DA, Nesbit SP. Does the cycle of rerestoration lead to larger restorations? J Am Dent Assoc. 1995;126(10):1407–13. https://doi.org/10.14219/jada.archive.1995.0052.

    Article  CAS  PubMed  Google Scholar 

  2. Gordan VV, Riley JL 3rd, Rindal DB, Qvist V, Fellows JL, Dilbone DA, et al. Repair or replacement of restorations: a prospective cohort study by dentists in The National Dental Practice-Based Research Network. Journal of the American Dental Association (1939). 2015;146(12):895–903.

    Article  Google Scholar 

  3. Wright JT, Tampi MP, Graham L, Estrich C, Crall JJ, Fontana M, et al. Sealants for preventing and arresting pit-and-fissure occlusal caries in primary and permanent molars: a systematic review of randomized controlled trials-a report of the American Dental Association and the American Academy of Pediatric Dentistry. Journal of the American Dental Association (1939). 2016;147(8):631–45.e18.

    Article  Google Scholar 

  4. Wright JT, Crall JJ, Fontana M, Gillette J, Novy BB, Dhar V, et al. Evidence-based clinical practice guideline for the use of pit-and-fissure sealants. JADA. 2016;147(8):672–82. https://doi.org/10.1016/j.adaj.2016.06.001.

    Article  PubMed  Google Scholar 

  5. O'Donnell JA, Modesto A, Oakley M, Polk DE, Valappil B, Spallek H. Sealants and dental caries: insight into dentists’ behaviors regarding implementation of clinical practice recommendations. JADA. 2013;144(4):e24–30. https://doi.org/10.14219/jada.archive.2013.0139.

    Article  PubMed  Google Scholar 

  6. Tellez M, Gray SL, Gray S, Lim S, Ismail AI. Sealants and dental caries: dentists’ perspectives on evidence-based recommendations. Journal of the American Dental Association (1939). 2011;142(9):1033–40.

    Article  Google Scholar 

  7. Polk DE, Weyant RJ, Shah NH, Fellows JL, Pihlstrom DJ, Frantsve-Hawley J. Barriers to sealant guideline implementation within a multi-site managed care dental practice. BMC Oral Health. 2018;18(1):17. https://doi.org/10.1186/s12903-018-0480-z.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Proctor EK, Powell BJ, McMillen JC. Implementation strategies: recommendations for specifying and reporting. Implement Sci. 2013;8(1):139. https://doi.org/10.1186/1748-5908-8-139.

    Article  PubMed  PubMed Central  Google Scholar 

  9. Yakovchenko V, Miech EJ, Chinman MJ, Chartier M, Gonzalez R, Kirchner JE, et al. Strategy configurations directly linked to higher hepatitis C virus treatment starts: an applied use of configurational comparative methods. Med Care. 2020;58(5):e31–e8. https://doi.org/10.1097/MLR.0000000000001319.

    Article  PubMed  PubMed Central  Google Scholar 

  10. Cavalier JJ. Democracy for beginners. Lebanon, NH: Steerforth Press; 2009.

    Google Scholar 

  11. Gruß I, Pihlstrom DJ, Kaplan CD, Yosuf N, Fellows JL, Guerrero EG, et al. Stakeholder assessment of evidence-based guideline dissemination and implementation in a dental group practice. JDR Clin Trans Res. 2020;2380084420903999.

  12. Michie S, Ashford S, Sniehotta F, Dombrowski S, Bishop A, French D. A refined taxonomy of behaviour change techniques to help people change their physical activity and healthy eating behaviours: the CALO-RE taxonomy. 2011;26:1479–98.

  13. Chan AW, Tetzlaff JM, Altman DG, Laupacis A, Gøtzsche PC, Krleža-Jerić K, et al. SPIRIT 2013 statement: defining standard protocol items for clinical trials. Ann Intern Med. 2013;158(3):200–7. https://doi.org/10.7326/0003-4819-158-3-201302050-00583.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Chan A, Tetzlaff JM, Gotzsche PC, Altman DG, Mann H, Berlin JA. SPIRIT 2013 explanation and elaboration: guidance for protocols of clinical trials. 2013;346:e7586.

  15. Hemming K, Girling A. A menu-driven facility for power and detectable-difference calculations in stepped-wedge cluster-randomized trials. Stata J. 2014;14(2):363–80. https://doi.org/10.1177/1536867X1401400208.

    Article  Google Scholar 

  16. Hussey MA, Hughes JP. Design and analysis of stepped wedge cluster randomized trials. Contemporary clinical trials. 2007;28(2):182–91. https://doi.org/10.1016/j.cct.2006.05.007.

    Article  PubMed  Google Scholar 

  17. Traeger AC, Lee H, Hubscher M, et al. Effect of intensive patient education vs placebo patient educatoin on outcomes in patients with acute low back pain: a randomized clinical trial. JAMA Neurology. 2019;76(2):161–9. https://doi.org/10.1001/jamaneurol.2018.3376.

    Article  PubMed  Google Scholar 

  18. Cane J, O’Connor D, Michie S. Validation of the theoretical domains framework for use in behaviour change and implementation research. 2012;7:37.

  19. Michie S, Atkins L, West R. The behaviour change wheel: a guide to designing interventions. London: Silverback Publishing; 2014.

    Google Scholar 

  20. Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. 1999;89(9):1322–7. https://doi.org/10.2105/AJPH.89.9.1322.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  21. Liang J, Farh CIC, Farh J-L. Psychological antecedents of promotive and prohibitive voice: a two-wave examination. Acad Manag J. 2012;55(1):71–92. https://doi.org/10.5465/amj.2010.0176.

    Article  Google Scholar 

  22. Spybrook J, Bloom H, Congdon R, Hill C, Martinez A, Raudenbush S, et al. Optimal design plus empirical evidence: documentation for the “Optimal Design” software. 2012.

    Google Scholar 

  23. Drummond MF, Sculpher MJ, Claxton K, Stoddart GL, Torrance GW. Methods for the economic evaluation of health care programmes. Fourth ed. Oxford, UK: Oxford University Press; 2015.

    Google Scholar 

  24. Gold MR, Siegel JE, Russell LB, WEinstein MC. Cost-effectiveness in health and medicine. New York: Oxford University Press; 1996.

    Google Scholar 

  25. Nixon RM, Wonderling D, Grieve RD. Non-parametric methods for cost-effectiveness analysis: the central limit theorem and the bootstrap compared. Health Econ. 2010;19(3):316–33. https://doi.org/10.1002/hec.1477.

    Article  PubMed  Google Scholar 

  26. Hunink MGM, Weinstein MC, Wittenberg E, Drummon MF, Pliskin JS, Wong JB, et al. Decision making in health and medicine: Integrating evidence and values. 2nd ed. Cambridge: Cambridge Unversity Press; 2014. https://doi.org/10.1017/CBO9781139506779.

    Book  Google Scholar 

  27. Fenwick E, O'Brian BJ, Briggs A. Cost-effectiveness acceptability curves – facts, fallacies, and frequently asked questions. Health Econ. 2004;13(5):405–15. https://doi.org/10.1002/hec.903.

    Article  PubMed  Google Scholar 

  28. VanderWeele TJ, Vansteelandt S. Mediation analysis with multiple mediators. Epidemiol Methods. 2014;2(1):95–115.

    CAS  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

We would like to acknowledge the consultants on this project including Jan Clarkson, Tim Dawson, Julie Frantsve-Hawley, Matthew Hornsey, Brian Mittman, Beth Nolan, John Prescott, and Bob Weyant; project staff including Sacha Reich and Michelle Shirey; and our Program Officials at NIDCR, Melissa Riddle and Elise Rice for their contributions and support.

Funding

This publication was supported by a grant from the National Institute of Dental and Craniofacial Research, grant number U01DE027452. The Program Officials provided feedback on the design of the study. Support for Erick Guerrero was provided by Research to End Healthcare Disparities Corp. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.

Author information

Authors and Affiliations

  1. University of Pittsburgh School of Dental Medicine, Pittsburgh, PA, USA

    Deborah E. Polk & Nilesh H. Shah

  2. Research to End Healthcare Disparities Corp, Los Angeles, CA, USA

    Erick G. Guerrero

  3. Kaiser Permanente Center for Health Research, Portland, OR, USA

    Inga Gruß, Nadia M. Yosuf & Jeffrey L. Fellows

  4. The Art of Democracy, Pittsburgh, PA, USA

    Tim Dawson

  5. Charles D. Kaplan Consulting, LLC, Los Angeles, USA

    Charles D. Kaplan

  6. Permanente Dental Associates, Portland, OR, USA

    Daniel J. Pihlstrom

Authors
  1. Deborah E. Polk
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Erick G. Guerrero
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Inga Gruß
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Nilesh H. Shah
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Nadia M. Yosuf
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Tim Dawson
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Charles D. Kaplan
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Daniel J. Pihlstrom
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Jeffrey L. Fellows
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

DEP, EGG, IG, NHS, NMY, TD, CDK, DJP, and JLK made substantial contributions to the conception or design of the work. DEP drafted the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Deborah E. Polk.

Ethics declarations

Ethics approval and consent to participate

This study was reviewed and approved by the Kaiser Permanente Northwest Institutional Review Board and the University of Pittsburgh Institutional Review Board.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Polk, D.E., Guerrero, E.G., Gruß, I. et al. Study protocol: A stepped-wedge, cluster-randomized trial of the effectiveness of a deliberative loop in identifying implementation strategies for the adoption of a dental sealant guideline in dental clinics. Implement Sci Commun 2, 96 (2021). https://doi.org/10.1186/s43058-021-00199-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s43058-021-00199-6

Keywords

Implementation Science Communications

ISSN: 2662-2211