Skip to main content

A peek behind the curtain: exploring coaching styles within the implementation and sustainment facilitation (ISF) strategy in the substance abuse treatment to HIV care study

Abstract

Background

The Grasha-Riechmann teaching styles, which includes three didactic and two prescriptive styles, have been shown to help enhance learning within educational settings. Although an adaption of the Grasha-Riechmann style classification has enabled coaching styles to be identified for use as part of quality improvement (QI) initiatives, research has not examined the styles actually utilized by coaches within a QI initiative or how the styles change overtime when the coach is guiding an organization through change implementation. Interactions between coaches and HIV service organization (HSO) staff participating in a large implementation research experiment called the Substance Abuse Treatment to HIV care (SAT2HIV) Project were evaluated to begin building an evidence base to address this gap in implementation research.

Methods

Implementation & Sustainment Facilitation (ISF) Strategy meetings (n = 137) between coaches and HSO staff were recorded and professionally transcribed. Thematic coding classifications were developed from the Grasha-Riechmann framework and applied to a purposively selected sample of transcripts (n = 66). Four coders independently coded transcripts using NVivo to facilitate text identification, organization, and retrieval for analysis. Coaching style use and changes across the three ISF phases were explored.

Results

Facilitator and formal authority were the two coaching styles predominately used. Facilitator sub-themes shifted from asking questions and providing support to supporting independent action over time. Coaches’ use of formal authority sub-styles shifted notably across time from setting expectations or ensuring preparation to offering affirmation or feedback about changes that the HSO’s were implementing. The use of the delegator or personal model coaching styles occurred infrequently.

Conclusions

The current research extends implementation research’s understanding of coaching. More specifically, findings indicate it is feasible to use the Grasha-Riechmann framework to qualitatively identify coaching styles utilized in a facilitation-based implementation strategy. More importantly, results provide insights into how different coaching styles were utilized to implement an evidence-based practice. Further research is needed to examine how coaching styles differ by organization, impact implementation fidelity, and influence both implementation outcomes and client outcomes.

Trial registration

ClinicalTrials.gov NCT02495402. Registered on July 6, 2015.

Peer Review reports

Background

Teacher, coach, and facilitator—the contextual situation defines our understanding. A teacher is often the individual who is involved in the education of students [1,2,3,4,5]. While a coach is often associated with sports, coach or coaching in the healthcare system is associated with sharing expertise (e.g., physician coaching on surgical checklist) to improve care [6,7,8,9]. The terms coach, implementation advisor, and facilitator are frequently used in implementation science research [10,11,12,13]. Coaching represents discrete and effective implementation strategies [14]. It involves scheduled and structured interactions between an individual with specific expertise and a variety of staff members who work within a healthcare setting [15, 16].

Regardless of the contextual situation and at the most basic level, the terms teacher, coach, implementation advisor, or facilitator, refer to an expert, either internal or external to the organization, who share their knowledge and expertise with other individuals (e.g., students, change teams) to achieve a specific outcome (e.g., meeting educational standards, winning a sporting event, improving medical skills, or successfully implementing change). Although different terms are used to refer to the same role or responsibility in implementation research, the activities that characterize that role or responsibility can vary greatly and often are not readily apparent or classifiable, as if concealed by a curtain. However, Walunas and colleagues highlight the importance of looking behind the curtain to better understand the active facilitation ingredients [12]. Better understanding coaching is especially important in the context of organizational change, given its multifaceted nature [8]. Additionally, given coaching often involves tailoring of coaching styles to build staff confidence to support change [17,18,19], it is important to study if and how coaching styles may change over time. Therefore, efforts to identify the use of coaching styles in a quality improvement collaborative to support the implementation of an evidence-based practice, and how coaching styles evolve over time represent just a few of the active ingredients behind the facilitation curtain.

Implementing evidence-based practices into routine health service practice can be a challenge, especially in the field of substance use disorder (SUD) treatment [20,21,22,23,24,25]. It is particularly important to improve the implementation of SUD services within HIV care settings given the high rates of SUD in individuals served in those settings [26,27,28]. The substance abuse treatment to HIV care (SAT2HIV) project tested the supplementation of the staff-focused Addiction Technology Transfer Center (ATTC) strategy with the team-focused Implementation & Sustainment Facilitation (ISF) Strategy within HIV service organizations (HSOs) in the USA [29]. For example, HSOs in the ATTC arm received centralized technical assistance related to motivational interview training, had access to tools and a system to evaluate the effectiveness of the motivational interviewing (MI) session, and received feedback on those sessions. HSOs assigned to the ISF strategy organized implementation teams, received support from an external facilitator, or “coach,” who guided the HSO staff in efforts to implement a motivational interviewing-based brief intervention (MIBI) for SUDs, and utilized interactive problem-solving and support to help the staff identify and achieve the project’s implementation goals. The main findings of the SAT2HIV Project were that the ISF strategy significantly improved the consistency and quality of implementation (i.e., implementation effectiveness), as well as decreased the odds of patients using their primary substance at follow-up [30].

Given the positive impact of the ISF strategy, our project team sought to better understand the extent to which different coaching styles were used as part of delivering the ISF strategy. In the SAT2HIV project, the implementation advisor or coach is defined as an individual with training and experience in assisting organizations with practice improvement and implementation efforts [29]. In this study, coaching represented an interaction between the coach and staff who were members of the HSO’s implementation team. Interactions between the ISF strategy coach and HSO implementation teams occurred on a regular basis (e.g., monthly) to support and encourage teams to harness skills and resources for achieving systemic change and improvement [31]. In the ISF strategy, the coach utilized structured presentations and tools, which helped maintain a common framework for interactions between the coach and each HSO’s implementation team [29]. Studies suggest that a coach’s experience, expertise, and style of relaying information and providing support may affect their effectiveness and organizational performance [10, 17, 18, 32,33,34,35,36].

Analytic framework

Different teaching styles have been shown to enhance learning in traditional educational environments [5, 37, 38]. In implementation science as identified in the ERIC strategies, the process of interactive problem solving through a supportive relationship (facilitation) relies on an implementation advisor (i.e., a coach) who provides ongoing consultation to support the implementation of the innovation [15, 16]. Coaching styles have been identified as being part of a surgical coaching framework [8], and coaching styles are an important factor in coach/coachee relationships [8, 11, 39, 40]. To begin understanding the implications of coaching styles, the analytic framework used for the current analysis reflects the Grasha-Riechmann Teaching Style Inventory (TSI). The TSI codifies styles and qualities of teachers into five teaching styles: Delegator, Expert, Facilitator, Formal Authority, and Personal Model [5, 41,42,43]. Additional file 1 provides a description of the coaching styles. In a study of 200 SUD treatment centers participating in a process improvement initiative, the Grasha-Reichmann model was successfully adapted and tested to identify the primary coaching styles preferred by coaches using the Quality Improvement Coach Teaching Style Inventory (QICTSI) [44, 45]. For example, all coaches (n = 17) utilized the facilitator style as a part of their primary approach to coaching.

Despite these encouraging findings, they are highly subjective given that the coaching/teaching traits were identified via self-administered surveys. In addition, research has not yet identified coaching styles utilized by coaches within a quality improvement (QI) initiative. More specifically, a coach possesses multiple coaching styles which could influence the relationship between the coach and organizational staff. As a result, a greater reliance on one or more specific coaching styles may be more valuable during different implementation phases as experienced in the SAT2HIV project, which, in turn, may influence implementation differently. Given the ISF strategy sessions in the SAT2HIV project were recorded and transcribed, there was a unique opportunity to investigate the feasibility of applying the Grasha-Riechmann style codes to qualitative data. Through a thematic analysis of recorded and transcribed ISF strategy sessions, we sought to identify the characteristics prominent within each of the coaching styles. This helps address an important gap in the extant implementation research literature, as few studies have examined the coaching styles employed as part of facilitation-based implementation strategies.

Objective

We assessed the extent to which coaching style changed over the course of the project’s three phases (preparation, implementation, and sustainment). We hypothesized that coaching style would change over time from didactic styles (Expert, Formal Authority, and Personal Model) to less prescriptive styles (Delegator, Facilitator) as the sites become more proficient and independent. To achieve this objective, we explored the methodological feasibility of using the QICTSI in a qualitative application.

Methods

Setting and context

Thirty-nine HSO’s located in 23 states and the District of Columbia within the United States were randomly assigned to either the ATTC strategy (control condition) or the ATTC + ISF strategy (experimental condition). Both conditions have been described in detail previously [29]. Coaching in the ISF strategy occurred during three phases (preparation, implementation, and sustainment), was provided by experienced coaches, and lasted 6 months (18 months in total for the three phases). Virtual meetings (approximately 30–60 min) between the coach and the HSO’s implementation team occurred monthly and focused on activities to support efforts by the HSO to implement the project’s MIBI. During the early part of the implementation phase, typically the second month of the implementation phase, a 4-h in-person ISF strategy meeting was conducted in lieu of the monthly virtual meeting.

Data

Data collection was conducted through digital recordings of ISF strategy meetings. To be included in the analysis, a HSO had to have at least one recorded meeting from each of the project’s three phases. While 137 meetings were recorded and transcribed from the 20 HSOs randomly assigned to receive the ISF Strategy, 10 of the HSOs only had transcripts from only one or two of the phases either because no meeting occurred, or the meeting was not recorded. As a result, transcripts (n = 29) from these HSOs were excluded from the study. Our final sample included 10 HSOs with 108 transcribed interviews that met the inclusion criteria. Recordings of ISF strategy meetings were then purposively selected from one of the three phases to achieve the final sample of transcribed meetings for coding. Participants typically included HSO leadership and the two MIBI staff [46]. All meetings were conducted in English and professionally transcribed.

Coding and analysis

We utilized a case study thematic analysis (TA) approach [47]. We followed the six-step framework as described by Braun and Clark [48]. A codebook with definitions consisting of 5 themes, which mirrored the five major teaching styles in the Grasha-Reichmann framework, was completed (see Additional File 2). Sub-themes were iteratively developed within the facilitator, formal authority, delegator, and personal model coaching styles. We double-coded 10% of the sample transcripts to conduct an intercoder reliability check to achieve greater than 80% inter-coder agreement [49,50,51,52]. The study team used thematic analysis with a mixed deductive and inductive approach at the semantic level to analyze key topics [48]. Coding was independently conducted by four researchers (JF, AG, MM, KH) using NVivo. Our coding method was not a black letter analysis, based on the presence of particular words, but rather it was an analysis of the concepts and processes inherent in statements. To address the study objectives, percentages were calculated from the frequency of coded language to determine changes in coaching styles over the three study phases. Recognizing that using percentages to quantify the frequency of coded language is not a traditional qualitative approach, percentages are only presented in tables and figures to demonstrate temporal variations and are not included in the body of this paper.

The study protocol was reviewed by the Institutional Review Board and deemed exempt. The Standards for Reporting Qualitative Research (SRQR) checklist [53] was utilized for this manuscript (Additional File 3).

Results

A total of 66 ISF strategy meetings were included in the analysis. The meetings averaged 40 min across the three phases with an average of three persons from an HSO per meeting (Table 1). The number of coded segments by coaching style, as well as the distribution of coaching styles across and within the phases, are shown in Table 1 and with a more detailed distribution in Additional File 4. Coaching styles are presented in the order of the frequency with which they were identified.

Table 1 Characteristics of the interview sample

Coaching style: formal authority

Cumulative use of statements representative of the formal authority approach showed the greatest frequency of all transcript codes. Formal authority was utilized equally in the preparation and implementation study phases but decreased somewhat during the sustainment phase. However, sub-themes within formal authority varied longitudinally (Fig. 1).

Fig. 1
figure 1

Distribution of formal authority sub-coaching styles by study phase

Affirmation and feedback

Two formal authority sub-themes—affirmation and feedback—occurred most frequently across the different phases (Fig. 1). The coaches’ use of affirmation was often generically in response to statements made by the HSO staff, as illustrated by phrases such as: “that’s great,” “that sounds great,” “thanks, okay, very helpful. I appreciate it,” or “that is a great question.” Feedback occurred when the coaches reacted to the performance by the HSO when integrating the MIBI into their existing workflow or in response to questions from the HSO staff regarding implementation efforts (Table 2). Examples include feedback about plans to implement a “cheat sheet” to guide client interactions (preparation), performance in the consistency of the MI ratings (implementation), or support for decisions not to continue the ISF strategy meetings (sustainment).

Table 2 Formal authority coaching sub-theme exemplary quotes

Providing information

This sub-theme often involved the coaches providing specific information about the SAT2HIV project and occurred most frequently during the implementation phase as compared to the preparation and sustainment phases. During the preparation and sustainment phases, the coaches often provided information, such as randomly selecting six clients to get the MIBI and then recording those sessions to get feedback from the ATTC staff (Table 2). However, in the implementation phase, a coach explained the purpose behind the MIBI quality ratings by saying “And this isn’t being done to grade you, per se” when affirming to the staff how well they were delivering the MIBI with their clients.

Explaining learning structure or process

This sub-theme, where the coach described the learning structure or provided information about QI tools and techniques, was one of the least frequently identified for the coaching style. What the coach emphasized within this sub-theme during each study phase varied (Table 2). In the preparation phase, coaches provided foundational, high-level, information about the project rationale, and overall goals. Information was also provided about the process with which the implementation team would be involved throughout the project, such as meeting schedules and which implementation team members would participate in various stages, as well as role designations (including the coaches’, as the knowledgeable guiding authority). Indeed, coaches transitioned from providing global information to offering specific descriptions of the process and structure for learning the MIBI and integrating it into practice, including specific tools and mechanisms that the team would use to accomplish continuous QI (e.g., feedback reports and individualized trainings). The implementation phase was characterized by the coaches leading the implementation team through activities to think critically about the feedback on the MIBIs and emphasizing the benefits of examining what happened during the MIBIs and how to improve the process by reviewing the manual and/or session recording. In the sustainment phase, examples of this sub-theme were the least prevalent because the coaches had already created the foundation and established the learning process and structure. During the sustainment phase, coaches described potential next steps for sustaining the MIBI (e.g., continuing monthly coaching meetings) and guiding discussions about the pros and cons of potential sustainment plans for their HSO given institutional priorities.

Setting expectations and ensuring preparation

Throughout the study phases, the sub-theme setting expectations/ensuring preparation consistently represented a notable proportion of the overall instances of the formal authority coaching style. Sub-theme prevalence decreased across the study phases (Fig. 1). The focus of coaching efforts to set expectations or ensure preparation differed by phase (Table 2). During the preparation phase, often when the coaches were describing the overall purpose of project, they would focus on what was expected from them and the team members to achieve agreed-upon goals. The activities focused on ensuring that team members were prepared (e.g., setting the stage about ATTC and ISF work), addressed implementation climate (i.e., the extent to which implementation was expected, supported, and rewarded), and discussed how each team member will contribute to team preparation. Distinct from long-term high-level expectations, coaches also established short-term expectations—describing meeting agenda items, establishing timeframes and deadlines for certain aspects of the study (e.g., number of participants to recruit and randomize within a certain timeframe), and providing direction about activities the team should accomplish before the next call. This setting of expectations sometimes involved an emotional component, when coaches tried to preemptively alleviate members’ concerns (e.g., acknowledging that a challenge may arise and assuring that it was to be expected) while also motivating members to focus on continuous QI and not be discouraged by challenges. Interestingly, this sub-theme in the implementation phase demonstrated largely similar characteristics as those identified during the preparation phase, except that activities were focused on implementation of the MIBI and preparing for transitioning to the sustainment phase. Compared to the earlier phases, there were the fewest instances of coaches utilizing this sub-theme during the sustainment phase. By this time, the teams had completed most of the meetings and tasks with the coaches, so there was less of a need for coaches to remind teams about upcoming activities of deadlines. Coaches had earlier set expectations about transitioning from implementation to sustainment, emphasizing the continued use of acquired skills/tools to help clients. Later in the sustainment phase, the coaches spent time discussing team expectations for next steps and whether they wanted to sustain the MIBI and continue with the ISF Strategy meetings.

Coaching style: facilitator

Of the various coaching styles, the cumulative category of facilitator represented at least a third of all coaching styles over the preparation and implementation periods but fell noticeably during the sustainment phase. It is important to note, however, that this pattern of effect tended to vary somewhat depending on the individual facilitator styles that were applied to the interview transcripts (see Fig. 2 for the longitudinal patterns of effects for each of the components of the facilitator style).

Fig. 2
figure 2

Distribution of facilitator sub-coaching styles by ISF study phase

Asking questions

Coaches asking questions of team members was the most frequently used sub-theme within the facilitator coaching style and characterized two-thirds of all identified facilitator sub-themes. Although most questions exemplified generic attempts to enquire about the need for additional information or clarification (e.g., “Any questions or concerns right now”), there were several specific instances where the questions were specific to content relevant for each of the 3 study phases (Table 3).

Table 3 Facilitator coaching sub-theme exemplary quotes

Capacity for independent action

Throughout the study phases, coaches took opportunities to develop teams’ capabilities for independent action related to the project. Coaches’ use of this sub-theme also increased substantially throughout the project timeframe (see Fig. 2). As with asking questions, attempts to improve independent activities are characterized by general guidance to achieve this objective, an exemplar of which is “keep trying to do that whenever you can and to give each other pointers.”

However, characteristics of substantive comments tended to vary by study phase (Table 3). The preparation phase dealt with efforts to demonstrate proficiency in the MIBI and the implementation process, with such activities involving brainstorming, training, skill development, resources, communication, planning strategies, and addressing potential challenges. The implementation phase generally consisted of discussions about process and workflow (e.g., recruitment, randomization, delivery of the MIBI) and strategizing in anticipation of the sustainment phase. Finally, the sustainment phase focused on whether and how to continue implementation of the MIBI.

Providing direction

Compared to other facilitator coaching styles, coaches provided directions to study team members the least. When examining the specific activities that were captured by this coding, both the preparation and implementation phases involved similar undertakings (Table 3). Such actions included improving the process, staff use of the tools, continued guidance about information needs, training, and protocol adherence, as well as timeline considerations (i.e., anticipating deadlines and goals. These activities largely focused on enhancing implementation plans, including screening and recruitment of client participants, and refining the strategies for working with those client participants. During the sustainment phase, although the same activities were identified as in the previous two phases, additional interests were evident. In the last study phase, coaches provided directions to improve the system and provision of services, transitioning to a sustained activity, assuring fidelity to the service model, and taking a “long-term view” of improving care for clients.

Suggesting options

Again, there were few instances of situations where a coach offered suggestions about directions forward on the project. Like facilitator sub-themes associated with capacity and providing direction, the coaches increased use of this sub-theme from the preparation to sustainment phase (Fig. 2). Coaches offered considerations about how implementation team members could work through problems and adjust approaches to achieve appropriate objectives, coordinating meetings before trainings (to assist preparation), and examining strategies that would fit within the HSO culture (Table 3). These recommendations were often based on the coaches’ previous experiences or when compared to ongoing initiatives in other organizations.

Supportive action or provides support

Offering to provide support to team members constituted the second-most frequently used facilitator-specific sub-theme. As shown in Fig. 2, the decrease in the use of this sub-theme over the course of the study was much more gradated than for the overall facilitator category. Even given this gradual frequency reduction over time, the types of activities identified as relevant to this coaching style largely remained markedly similar throughout the study phases such as sharing information, including notes of meetings and invitations for next meetings, providing resources (e.g., PowerPoint slides, data collection tools), tasks to accomplish, and experience with other HSOs (Table 3). Additional coach activities involved offering their contact information for quick communication and assistance with the process, helping achieve certain objectives, and addressing problems or questions. Finally, there was a consistent willingness on the part of coaches to offer further training to others who could provide services.

Coaching style: expert

In the expert coaching style, the coach often possesses knowledge, information, and expertise that is shared to ensure that the organization is ready to implement change and will be successful. Overall, the cumulative use of the Expert coaching style was the third most frequent across the preparation, implementation, and sustainment phases (Table 1). Coaches utilized this style to transmit information about the project, often displaying detailed knowledge about the project or relaying how their experiences might inform the implementation and/or sustainment of the MIBI.

Use of the expert style varied within each phase. In the preparation phase, coaches shared knowledge about planning for organizational change and emphasized that planning alone is not sufficient. Coaches stressed the importance of a comprehensive approach to putting plans into action with a recognition that overcoming current practices would not be easy. For example, they encouraged staff that “the only way to really start to do it is to just practice it, to do the roleplay” and reinforced the message that staff would gain the “knowledge and skill to do [MIBI]” through practice. Coaches also emphasized that proper planning ensures MIBI delivery with consistency and quality by offering specific suggestions such as “staff have to be focused and motivated and have to figure out a way to make sure you don’t disrupt your relationships with the clients.”

Expert coaching styles differed in the implementation and sustainment phases. During implementation, a coach was likely to share a case story or experience. The purpose of the exchange was to promote and encourage engagement by the HSO staff. In other instances, these shared stories re-enforced those actions taken by the HSO staff were consistent with their experiences. For example, one HSO was struggling with continuity after screening a client, especially when they did not show up for the next scheduled appointment. In this case, the coach indicated that he/she had been working with no-shows for the past 10 years and indicated that actions taken by HSO staff was consistent with their experience (Table 5).

In the sustainment phase, the coaches depended more on the expert coaching style as reliance on the formal authority coaching style decreased (Table 1). Specifically, they shared their expertise about how internal challenges (e.g., grant writing) or how the external environment (e.g., regulations) hindered sustainment. More importantly, a coach asked questions, like “What would you want to learn more about brief intervention before you … really committed [MIBI] to the standard operating procedures of the organization?,” to promote efforts to sustain the MIBI intervention. An exchange between the agency and coach highlights the importance of organizational motivation to sustain the change (Table 5).

Coaching style: delegator

This coaching style was not often utilized by the coaches (Table 1). In this style, the coaches were mostly concerned with developing team capacity to function autonomously by encouraging specific actions or directing the team to seek the support needed to carry out project related activities. To delegate tasks, the coaches also cultivated self-direction, while always ensuring that staff understood they could rely on him/her as a resource, reach out to him/her between meetings if they had any questions, and even offering help with specific tasks (Table 4). With the delegator style, the coaches would offer advice about how to carry out a task and take immediate independent action. Instilling a practice of forethought, so that participants could be thinking of “how you’ll be doing, say, six months from now,” was an important element within the delegator style and enabled participants to better understand what was expected of them. The coach accomplished this by being directive and helping the team understand what was expected or by providing specific directions including what the coach would like the HSO staff to discuss on their coaching calls. The coaches also affirmed independent actions which enabled participants to know they were on the right track with MIBI implementation. In addition to these activities, the coaches would provide guidance about not just what but who might be involved in tasks. For example, the coaches would provide specific direction about who might be on a specific call or involved in a specific project. Finally, delegating tasks to be completed between meetings was commonly observed.

Table 4 Delegator coaching sub-theme exemplary quotes
Table 5 Exemplary quotes from the expert coaching style
Table 6 Personal model coaching sub-style theme exemplary quotes style

Coaching style: personal model

The personal model coaching style was the least utilized style both overall and across the intervention phases. When using the personal model style, the coach teaches by example, often using phrases such as “this is what I would recommend, or this is what I would do” to provide direction without being overly prescriptive (Table 6). The use of prior experiences reflected opportunities for coaches to provide recommendations based on their personal experience or what they might do when faced with a similar situation. An example of this is discussing with the HSO staff about the potential use of gift cards to incentivize clients. When providing direction, language was identified that gently guided HSO staff, providing opinions not just about specific tasks, but approach and style. This was particularly effective where nuance was needed in situations that might have been difficult. For example, when staff were lamenting the amount of paperwork needing to be completed, the coaches offered sympathy. However, the coach, when using the Personal Model, may tend to offer suggestions more frequently to the change team rather than let them explore options and make informed choices about change in their organization.

Discussion

Coaching is a recommended implementation strategy. Evidence clearly indicates that coaching, in general, is effective and, more specifically, coaching as part of the SAT2HIV project’s ISF strategy improved implementation effectiveness, as well as the effectiveness of the MIBI [30]. This research extends the understanding of coaching in implementation research. It builds on prior research in which the Grasha-Riechmann TSI was adapted to identify coaching styles in QI [45]. We adapted the coaching styles and qualitatively assessed how they were utilized within a QI collaborative to support efforts by HSOs to implement the project’s MIBI for SUDs among people with HIV. The study also examined coaching styles within each study phase and longitudinally.

Coaches rely on their expertise (skills, knowledge, and experience) and personality characteristics (level of respect or trust) to help staff identify and overcome barriers, promote continuous improvement, and facilitate adoption of evidence-based practices [54]. We found that coaches primarily relied on one of three coaching styles—facilitator, formal authority, and expert—as they worked with HSOs overall and within each of the study phases. These results only partially agree with prior research. When interacting with SUD treatment organizations in the NIATx200 initiative, coaches preferred to use either the facilitator, delegator, or personal model as their primary coaching style [45]. The NIATx200 findings were based on a coaches’ self-assessment and in contrast, our analysis based on independent coding of coach transcripts of the actual interaction with the HSOs. These findings suggest that coach perceptions about their coaching styles differ from the styles that they utilized when interacting with staff. This discrepancy may result from the qualitative coding approach being better able to assess and identify the variability in coaching styles that occur both within and throughout the preparation, implementation, and sustainability phases of this study.

Coaching for organizational or individual change is multifaceted. For example, a surgical coaching framework suggests that coaches rely on distinct yet interrelated activities of coaching—setting goals, encouraging, and motivating, and developing and guiding which are supported by coach interpersonal skills including their coaching style [8]. In our study, coaching styles used within each phase (preparation, implementation, and sustainment) shifted both within the phase and over time by coaching style. In these situations, coaches (like other teachers) tailor the learning interchange to individual needs and goals and use active (e.g., a hands-on Plan-Do-Study-Act activity) vs. passive (e.g., a lecture on data collection and measurement) learning approaches to develop skills and build confidence [17,18,19]. In the context of the SAT2HIV project, coaches changed their styles to guide the HSOs in addressing specific issues within each implementation phase. For example, a greater reliance on the formal authority style (a prescriptive coaching style) during the preparation and implementation phases involved the coach providing feedback about the approach utilized by the HSOs to recruit clients to the stud or to set expectations about what the HSO staff needed to do when implementing the MIBI in their organization. As HSO staff grew more comfortable in their ability to implement change, the coach used less prescriptive coaching styles (e.g., facilitator) to support independent action from staff by suggesting options for how they could implement change. This shift in coaching styles is consistent with the age-old adage of the importance of teaching an individual how to fish. The evolution of the coaching styles as seen in the SAT2HIV Project is consistent with prior research which suggest that facilitation activities evolve over time [11, 55,56,57].

However, the reliance by the coach on less prescriptive styles (facilitator and delegator) was only partially supported as hypothesized. Our results indicated that the use of less prescriptive styles only changed from the implementation to the sustainment phase but not from the preparation to the implementation phase. This change was primarily associated with a greater use of the facilitator style to build capacity for independent action, provide direction, and suggest options versus asking questions or providing support to the teams. We also found that the coaches’ increased their use of the expert style during the sustainment phase. This may have been associated with the coach sharing their knowledge about sustainment, a concept often overlooked during the implementation of organizational change. The relationship between the use of specific coaching styles and implementation efficiency was not explored in this research.

Coaching should indeed be considered a “composite approach,” although a coach may utilize a particular style to a greater extent. While it is true that a given statement from the transcript is reflective of a discrete teaching style, the amalgam of statements that coaches make reflects their ability to adopt different coaching styles when responding to situational demands. As such, the coach did not solely rely on this singular coaching style despite the presence of one or more preferred coaching styles in each phase. Instead, their approach and style used when interacting with HSO staff varied during the calls as evident by the number of coded segments per interview. This finding is consistent with prior research which suggests that the coach engages in multiple activities when supporting efforts by the organization to implement change [8, 58].

Although these novel findings support the effectiveness of a qualitative approach to classify coaching styles, this study had several limitations. First, only 65% of all coaching calls had a recording that could be used to create a potential transcript for coding. Calls not recorded were typically due to technology issues or a coach forgetting to record the call. Consequently, the absence of available transcripts limited coding to 10 HSOs and represents an analysis based on only about half of the HSOs who received the ISF Strategy. Second, the inability to explore coaching styles across all participating HSOs limits the ability to draw any generalizable conclusions and about whether the pattern of use of a particular coaching style or combination of styles was associated with improved implementation effectiveness. Finally, it is possible that the purposive selection of interview transcripts for coding might have influenced the results, especially if a coach relied more on less-utilized coaching styles (e.g., delegator) with a HSO in one of the study phases (e.g., sustainment).

Conclusion

Overall, this qualitative study indicates that it is feasible to use the Grasha-Riechmann framework as the conceptual foundation for coding transcripts from coaching calls within a facilitation-based implementation strategy. Unlike the Wizard of Oz, who strove to conceal his identity and “process” behind a curtain, we benefit by pulling the curtain aside to begin revealing what coaching styles are being utilized to implement a MIBI in HSOs. This glimpse provides insights into how coaches guide and teach staff throughout the implementation journey. Future investigations into coaching styles should employ a mixed-methods approach to compare the qualitative analyses of coaching transcripts to the fidelity of the ISF strategy and triangulate quantitative and qualitative data to better understand facilitation-based interventions and determine the influence of coaching styles on outcomes. With this knowledge, implementation researchers could tailor the coaching experience to prevalent coaching styles to improve the coaching experience. Specifically, coaching styles should be determined for the external facilitator or coach at the start of an implementation research study. If done in conjunction with a determination of the preferred learning styles of participants, the structure and content delivery mechanism for coach delivered content could be matched to the appropriate coaching style(s) to improve uptake by the study participants. A more tailored and structured approach might result in greater improvement and sustainment of implementation outcomes.

Availability of data and materials

The datasets analyzed during this study are not publicly available given privacy protections for individual level data collected for the study and the potential for re-identification of practice participants. Datasets are available from the corresponding author on reasonable request.

Abbreviations

ATTC:

Addiction Technology Transfer Center

HSO:

HIV Service Organization

ISF:

Implementation & Sustainment Facilitation

MI:

Motivational interviewing

MIBI:

Motivational interviewing-based intervention

QI:

Quality improvement

QICTSI:

Quality Improvement Coach Teaching Style Inventory

SAT2HIV:

Substance abuse treatment to HIV

SUD:

Substance use disorder

References

  1. Grasha AF. A matter of style: the teacher as expert, formal authority, personal model, facilitator, and delegator. College Teach. 1994;42:142–9 https://doi.org/10.1080/87567555.1994.9926845.

    Article  Google Scholar 

  2. Grasha AF. The dynamics of one-on-one teaching. College Teach. 2002;50:139–46 https://doi.org/10.1080/87567550209595895.

    Article  Google Scholar 

  3. Grasha AF, Yangarber-Hicks N. Integrating teaching styles and learning styles with instructional technology. College Teach. 2000;48:2–10 https://doi.org/10.1080/87567550009596080.

    Article  Google Scholar 

  4. Vaughn L, Baker R. Teaching in the medical setting: balancing teaching styles, learning styles and teaching methods. Medical Teach. 2001;23:610–2 https://doi.org/10.1080/01421590120091000.

    Article  Google Scholar 

  5. Vaughn LM, Baker RC. Do different pairings of teaching styles and learning styles make a difference? Preceptor and resident perceptions. Teach Learn in Med. 2008;20:239–47 https://doi.org/10.1080/10401330802199559.

    Article  Google Scholar 

  6. Gawande A: Personal best: top athletes and singers have coaches. Should you? The New Yorker. October 3, 2011. https://facstaff.necc.mass.edu/wp-content/uploads/2012/01/personal_best_coaching_article.pdf. Accessed 13 Sept 2021.

  7. Semrau KEA, Hirschhorn LR, Marx Delaney M, et al. Outcomes of a coaching-based WHO safe childbirth checklist program in India. N Engl J Med. 2017;377(24):2313–24 https://doi.org/10.1056/nejmoa1701075.

    Article  Google Scholar 

  8. Greenberg CC, Ghousseini HN, Pavuluri Quamme SR, Beasley HL, Wiegmann DA. Surgical coaching for individual performance improvement. Ann Surg. 2015;261(1):32–4 https://doi.org/10.1097/sla.0000000000000776.

    Article  Google Scholar 

  9. Hu YY, Mazer LM, Yule SJ, et al. Complementing operating room teaching with video-based coaching. JAMA Surg. 2017;152(4):318–25 https://doi.org/10.1001/jamasurg.2016.4619.

    Article  Google Scholar 

  10. Tout K, Isner T, Zaslow M. Coaching for quality improvement: lessons learned from quality rating and improvement systems (QRIS). Research brief. Washington, DC: Child Trends; 2011.

    Google Scholar 

  11. Ritchie MJ, Parker LE, Kirchner JE. From novice to expert: methods for transferring implementation facilitation skills to improve healthcare delivery. Implement Sci Commun. 2021;2(1):39. Published 2021 Apr 8. 10.1186%2Fs43058-021-00138-5.

  12. Walunas TL, Ye J, Bannon J, et al. Does coaching matter? Examining the impact of specific practice facilitation strategies on implementation of quality improvement interventions in the Healthy Hearts in the Heartland study. Implement Sci. 2021;16(1):33. Published 2021 Mar 31. https://doi.org/10.1186/s13012-021-01100-8.

  13. Smith SN, Liebrecht CM, Bauer MS, Kilbourne AM. Comparative effectiveness of external vs blended facilitation on collaborative care model implementation in slow-implementer community practices. Health Serv Res. 2020;55(6):954–65 https://doi.org/10.1111/1475-6773.13583.

    Article  Google Scholar 

  14. Baskerville NB, Liddy C, Hogg W. Systematic review and meta-analysis of practice facilitation within primary care settings. Ann Fam Med. 2012;10(1):63–74 https://doi.org/10.1370/afm.1312.

    Article  Google Scholar 

  15. Powell BJ, Waltz TJ, Chinman MJ, et al. A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project. Implement Sci. 2015;10:21. Published 2015 Feb 12. https://doi.org/10.1186/s13012-015-0209-1.

  16. Waltz TJ, Powell BJ, Matthieu MM, et al. Use of concept mapping to characterize relationships among implementation strategies and assess their feasibility and importance: results from the Expert Recommendations for Implementing Change (ERIC) study. Implement Sci. 2015;10:109. Published 2015 Aug 7. doi:https://doi.org/10.1186/s13012-015-0295-0. https://doi.org/10.1186/s13012-015-0295-0.

  17. Garner BR. Research on the diffusion of evidence-based treatments within substance abuse treatment: a systematic review. J Subst Abus Treat. 2009;36(4):376–99 https://doi.org/10.1016/j.jsat.2008.08.004.

    Article  Google Scholar 

  18. Hogan MF. The President's new freedom commission: recommendations to transform mental health care in America. Psychiatr Serv. 2003;54(11):1467–74 https://doi.org/10.1176/appi.ps.54.11.1467.

    Article  Google Scholar 

  19. Institute of Medicine (US) Committee on crossing the quality chasm: adaptation to mental health and addictive disorders. Improving the Quality of Health Care for Mental and Substance-Use Conditions: Quality Chasm Series. Washington (DC): National Academies Press (US); 2006. https://doi.org/10.17226/11470.

  20. Institute of Medicine (US) Committee on Quality of Health Care in America. Crossing the quality chasm: a new health system for the 21st century. Washington (DC): National Academies Press (US); 2001. https://doi.org/10.17226/10027.

  21. Institute of Medicine (US) Committee on community-based drug treatment, Lamb S, Greenlick MR, McCarty D, eds. Bridging the gap between practice and research: forging partnerships with community-based drug and alcohol treatment. Washington (DC): National Academies Press (US); 1998. https://doi.org/10.17226/6169.

  22. Hoffman KA, Ponce Terashima J, McCarty D. Opioid use disorder and treatment: challenges and opportunities. BMC Health Serv Res. 2019;19(1):884. Published 2019 Nov 25. https://doi.org/10.1186/s12913-019-4751-4.

  23. Bing EG, Burnam MA, Longshore D, et al. Psychiatric disorders and drug use among human immunodeficiency virus-infected adults in the United States. Arch Gen Psychiatry. 2001;58(8):721–8 https://doi.org/10.1001/archpsyc.58.8.721.

    Article  CAS  Google Scholar 

  24. Gaynes BN, Pence BW, Eron JJ Jr, Miller WC. Prevalence and comorbidity of psychiatric diagnoses based on reference standard in an HIV+ patient population. Psychosom Med. 2008;70(4):505–11 https://doi.org/10.1097/psy.0b013e31816aa0cc.

    Article  Google Scholar 

  25. Hartzler B, Dombrowski JC, Crane HM, et al. Prevalence and predictors of substance use disorders among HIV care enrollees in the United States. AIDS Behav. 2017;21(4):1138–48 https://doi.org/10.1007/s10461-016-1584-6.

    Article  Google Scholar 

  26. Garner BR, Zehner M, Roosa MR, et al. Testing the implementation and sustainment facilitation (ISF) strategy as an effective adjunct to the Addiction Technology Transfer Center (ATTC) strategy: study protocol for a cluster randomized trial. Addict Sci Clin Pract. 2017;12(1):32. Published 2017 Nov 17. https://doi.org/10.1186/s13722-017-0096-7.

  27. Garner B, Gotham H, Chaple M, Martino S, Ford J, Roosa M, et al. The Implementation & Sustainment Facilitation Strategy improved implementation effectiveness and intervention effectiveness: results from a cluster-randomized type 2 hybrid trial. Implement Res Pract. 2020;1 https://doi.org/10.1177/2633489520948073.

  28. Stetler CB, Legro MW, Rycroft-Malone J, et al. Role of "external facilitation" in implementation of research findings: a qualitative evaluation of facilitation experiences in the Veterans Health Administration. Implement Sci. 2006;1:23. Published 2006 Oct 18. https://doi.org/10.1186/1748-5908-1-23.

  29. Donaldson N, Rutledge D, Geiser K. Role of the external coach in advancing research translation in hospital-based performance improvement. In: Henriksen K, Battles JB, Keyes MA, Grady ML, editors. Advances in patient safety: new directions and alternative approaches, Vol. 2. Rockville, MD: Agency for Healthcare Research and Quality; 2008. p. 1–29.

    Google Scholar 

  30. Nagykaldi Z, Mold JW, Aspy CB. Practice facilitators: a review of the literature. Fam Med. 2005;37(8):581–8.

    PubMed  Google Scholar 

  31. Isner T, Tout K, Zaslow M, Soli M, Quinn K, Rothenberg L, Burkhauser M. Coaching in early care and education programs and quality rating and improvement systems (QRIS): identifying promising features. Washington, DC: Child Trends; 2011. https://www.childtrends.org/wp-content/uploads/2014/09/2011-47CoachingEarlyCareEducation.pdf. Accessed 13 Sept 2021.

  32. Medland J, Stern M. Coaching as a successful strategy for advancing new manager competency and performance. J Nurses Staff Dev. 2009;25(3):141–7 https://doi.org/10.1097/nnd.0b013e3181a56f0a.

    Article  Google Scholar 

  33. Schneider KL, Agins BD, Ng DW, Monserrate JM, Hirschhorn LR. Evaluation of regional HIV provider quality groups to improve care for people living with HIV served in the United States. J Health Care Poor Underserved. 2012;23(3 Suppl):174–92 https://doi.org/10.1353/hpu.2012.0142.

    Article  Google Scholar 

  34. Feldman DC, Lankau MJ. Executive coaching: a review and agenda for future research. J Manage. 2005;31:829–48 https://doi.org/10.1177/0149206305279599.

    Google Scholar 

  35. Wilson T, Berwick DM, Cleary PD. What do collaborative improvement projects do? Experience from seven countries. Joint Comm J Quality Safety. 2003;29:85–93 https://doi.org/10.1016/S1549-3741(03)29011-0.

    Google Scholar 

  36. Costa ML, van Rensburg L, Rushton N. Does teaching style matter? A randomised trial of group discussion versus lectures in orthopaedic undergraduate teaching. Med Educ. 2007;41:214–7 https://doi.org/10.1111/j.1365-2929.2006.02677.x.

    Article  Google Scholar 

  37. Jones S, Gopalakrishnan S, Ameh CA, Faragher B, Sam B, Labicane RR, et al. Student evaluation of the impact of changes in teaching style on their learning: a mixed method longitudinal study. BMC Nurs. 2018;17:24 https://doi.org/10.1186/s12912-018-0293-z.

    Article  Google Scholar 

  38. Norman AC, Fritzén L, Gäre BA. Pedagogical approaches in quality improvement coaching in healthcare: a Swedish case study of how improvement coaches approach learning in a contemporary healthcare system. Nord J Stu Educ Pol. 2015;3 https://doi.org/10.3402/nstep.v1.30178.

  39. Olson JR, McCarthy KJ, Perkins DF, Borden LM. A formative evaluation of a coach-based technical assistance model for youth- and family-focused programming. Eval Program Plann. 2018;67:29–37 https://doi.org/10.1016/j.evalprogplan.2017.11.002.

    Article  Google Scholar 

  40. Grasha AF. Teaching with style: a practical guide to enhancing learning by understanding teaching and learning styles. San Bernadino, CA: Alliance Publishers; 1996.

    Google Scholar 

  41. Chetty NDS, Handayani L, Sahabudin NA, Ali Z, Hamzah N, Rahman NSA, et al. Learning styles and teaching styles determine students' academic performances. Int J Eval Res Educ. 2019;8:610–5 https://doi.org/10.11591/ijere.v8i4.20345.

    Google Scholar 

  42. Ghanizadeh A, Jahedizadeh S. EFL teachers’ teaching style, creativity, and burnout: a path analysis approach. Cogent Educ. 2016;3:1151997 https://doi.org/10.1080/2331186X.2016.1151997.

    Article  Google Scholar 

  43. Ford JH, Robinson J. Teaching and learning styles in quality improvement: identification and impact on process outcomes. Addict Sci Clin Pract. 2015;10:A12 https://doi.org/10.1186/1940-0640-10-S1-A12.

    Article  Google Scholar 

  44. Ford JH 2nd, Robinson JM, Wise ME. Adaptation of the Grasha Riechman student learning style survey and teaching style inventory to assess individual teaching and learning styles in a quality improvement collaborative. BMC Med Educ. 2016;16:252 https://doi.org/10.1186/s12909-016-0772-4.

    Article  Google Scholar 

  45. Garner BR, Gotham HJ, Tueller SJ, Ball EL, Kaiser D, Stilen P, et al. Testing the effectiveness of a motivational interviewing-based brief intervention for substance use as an adjunct to usual care in community-based AIDS service organizations: study protocol for a multisite randomized controlled trial. Addict Sci Clin Pract. 2017;12:31 https://doi.org/10.1186/s13722-017-0095-8.

    Article  Google Scholar 

  46. Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psych. 2006;3:77–101 https://doi.org/10.1191/1478088706qp063oa.

    Article  Google Scholar 

  47. Creswell JW, Creswell JD. Research design: qualitative, quantitative, and mixed methods approaches: SAGE Publications; 2017.

    Google Scholar 

  48. MacPhail C, Khoza N, Abler L, Ranganathan M. Process guidelines for establishing intercoder reliability in qualitative studies. Qual Res. 2016;16:198–212 https://doi.org/10.1177/1468794115577012.

    Article  Google Scholar 

  49. Krippendorff K. Content analysis: an introduction to its methodology. 4th ed. Beverly Hills, CA: Sage Publications; 2018.

    Google Scholar 

  50. Popping R. Some views on agreement to be used in content analysis studies. Qual Quant. 2010;44:1067–78 https://doi.org/10.1007/s11135-009-9258-3.

    Article  Google Scholar 

  51. Garrison DR, Cleveland-Innes M, Koole M, Kappelman J. Revisiting methodological issues in transcript analysis: negotiated coding and reliability. Internet Higher Educ. 2006;9:1–8 https://doi.org/10.1016/j.iheduc.2005.11.001.

    Article  Google Scholar 

  52. O'Brien BC, Harris IB, Beckman TJ, Reed DA, Cook DA. Standards for reporting qualitative research: a synthesis of recommendations. Acad Med. 2014;89(9):1245–51 https://doi.org/10.1097/acm.0000000000000388.

    Article  Google Scholar 

  53. Knox L. Report on the AHRQ 2010 consensus meeting on practice facilitation for primary care improvement. Agency for Healthcare Research and Quality: Rockville, MD; 2010.

    Google Scholar 

  54. Baykul Y, Gursel M, Sulak H, Ertekin E, Yazici E, Dulger O, et al. A validity and reliability study of Grasha-Riechmann student learning style scale. Internat J Human Soc Sci. 2010;5:177–84.

    Google Scholar 

  55. Bidassie B, Williams LS, Woodward-Hagg H, Matthias MS, Damush TM. Key components of external facilitation in an acute stroke quality improvement collaborative in the Veterans Health Administration. Implement Sci. 2015;10:69. Published 2015 May 14. https://doi.org/10.1186/s13012-015-0252-y.

  56. Waterman H, Boaden R, Burey L, et al. Facilitating large-scale implementation of evidence based health care: insider accounts from a co-operative inquiry. BMC Health Serv Res. 2015;15:60. Published 2015 Feb 13. https://doi.org/10.1186/s12913-015-0722-6.

  57. Shoobridge J, Schultz T, Harvey G, Kirby N. Using an implementation science approach to build leader facilitation capability in healthcare: a novel approach for enhancing action learning set facilitation. J Health Organ Manag. 2021; ahead-of-print (ahead-of-print). https://doi.org/10.1108/JHOM-12-2020-0510.

  58. Ritchie MJ, Kirchner JE, Parker LE, et al. Evaluation of an implementation facilitation strategy for settings that experience significant implementation barriers. Implement Sci. 2015;10(Suppl 1):A46. Published 2015 Aug 20. https://dx.doi.org/10.1186%2F1748-5908-10-S1-A46.

Download references

Acknowledgements

This project would not have been possible without both the participation and collaboration of the project’s 39 organizations and their dedicated staff, as well as the participation of the organization’s client participants.

Funding

This work was supported by the National Institute on Drug Abuse (NIDA; R01DA038146; PI Garner and NIDA; R03 DA034956; PI: Ford). NIDA had no role in the design of this study and will not have any role during its execution, analyses, interpretation of the data, or decision to submit results. The contents of this publication are solely the responsibility of the authors and do not necessarily represent the official views of the government or participating organizations.

Author information

Authors and Affiliations

Authors

Contributions

JHF conceptualized the research question, helped develop the study design and coding scheme, coded the survey interviews, helped interpret the coding results, and was a major contributor in writing the manuscript. AMG helped develop the study design and coding scheme, coded the survey interviews, helped interpret the coding results, and was a major contributor in writing the manuscript. MAM helped develop the study design and coding scheme, coded the survey interviews, helped interpret the coding results, and was a major contributor in writing the manuscript. KAH helped develop the study design and coding scheme, developed the coding codebook, calculated the inter-coder agreement statistics, coded the survey interviews, helped interpret the coding results, and was a major contributor in writing the manuscript. BRG provided access to the recordings and reviewed manuscript drafts. The authors read and approved the final manuscript.

Corresponding author

Correspondence to James H. Ford II.

Ethics declarations

Ethics approval and consent to participate

The study protocol was reviewed by the Institutional Review Board and deemed exempt.

Consent for publication

Not applicable.

Competing interests

The authors have no competing interests to disclose.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional File 1.

Description of Quality Improvement Collaborative Teaching Styles

Additional File 2.

SAT2HIV Qual Codebook

Additional file 3.

Standards for Reporting Qualitative Research (SRQR) checklist

Additional file 4.

Overview of Coded Interview Segments

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ford, J.H., Gilson, A.M., Maurer, M.A. et al. A peek behind the curtain: exploring coaching styles within the implementation and sustainment facilitation (ISF) strategy in the substance abuse treatment to HIV care study. Implement Sci Commun 2, 140 (2021). https://doi.org/10.1186/s43058-021-00246-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s43058-021-00246-2

Keywords