- Open Access
Exploring the heterogeneity of factors that may influence implementation of PrEP in family planning clinics: a latent profile analysis
Implementation Science Communications volume 2, Article number: 48 (2021)
Title X-funded family planning clinics have been identified as optimal sites for delivery of pre-exposure prophylaxis (PrEP) for HIV prevention. However, PrEP has not been widely integrated into family planning services, especially in the Southern US, and data suggest there may be significant implementation challenges in this setting. Because Title X clinics vary greatly in provider-, organizational-, and systems-level characteristics, there is likely variation in capacity to implement PrEP across clinics.
We conducted a survey from February to June 2018 among providers and administrators of non-PrEP-providing Title X-funded clinics across 18 southern states. Survey items were designed using the Consolidated Framework for Implementation Research (CFIR) to assess constructs relevant to PrEP implementation. To explore the heterogeneity of CFIR-related implementation determinants and identify distinct sub-groups of Title X clinics, a latent profile analysis was conducted using nine CFIR constructs: complexity, relative advantage, cost, attitudes, implementation climate, compatibility, leadership engagement, available resources, and cosmopolitanism. We then conducted a multi-level analysis (accounting for nesting of participants within clinics) to test whether group membership was associated with readiness for implementation of PrEP, controlling for key sociodemographic characteristics.
Four hundred and fourteen healthcare providers/administrators from 227 non-PrEP-providing Title X clinics participated in the study. We identified six sub-groups of clinics that each had distinct patterns of PrEP implementation determinants. Clinic sub-groups included “Highest Capacity for Implementation”, “Favorable Conditions for Implementation”, “Mixed Implementation Context”, “Neutral Implementation Context”, “Incompatible Setting for Implementation”, and “Resource-Strained Setting”. Group membership was related to numerous provider-level (i.e., ability to prescribe medication) and clinic-level (i.e., provision of primary care) characteristics. In comparison to the “Neutral” group (which held neutral perceptions across the implementation determinants), the “Highest Capacity” and “Favorable Conditions” groups had significantly higher levels of implementation readiness, and the “Resource-Strained” group had a significantly lower level of implementation readiness.
Latent profile analyses can help researchers understand how implementation readiness varies across healthcare settings, promoting tailoring of implementation strategies to unique contexts.
Women account for approximately 20% of all new HIV infections in the United States (US), with a disproportionate number of new diagnoses occurring in the South [1, 2]. Effective HIV prevention efforts for women in the South are needed, not only to curb the epidemic among this population, but also to protect their sexual partners and prevent perinatal infection [1, 2]. HIV Pre-exposure prophylaxis (PrEP) is a safe and effective intervention to prevent HIV infection among women [3, 4]. However, PrEP utilization, access, and awareness remain low among women of all ages in the US [5,6,7,8,9]. For instance, in 2017, only 6% of PrEP users were women, and among the 176,670 heterosexual women for which PrEP was indicated, only 2% received a prescription [10,11,12,13].
Particularly for women in the South, a major barrier to PrEP utilization is low access to PrEP-providing clinics [13, 14]. PrEP is not widely offered in settings that women regularly receive sexual health and preventative services, such as women’s healthcare and family planning clinics [6, 13,14,15]. Integrating PrEP into settings where women regularly receive healthcare is a priority for mitigating the HIV epidemic among this population . Specifically, Title X-funded family planning clinics in high HIV incidence settings (such as much of the Southern US) have been identified as optimal PrEP delivery sites for women. Title X family planning clinics are potentially ideal for expanding PrEP services for women, since they are an important safety net source of care and are already widely utilized by women for sexual health services, including HIV testing and education [17, 18]. There are approximately 4000 Title X-funded family planning clinics across the US, which serve over 4 million clients — the majority of which are low-income women [19, 20]. For many of these women, Title X clinics serve as their usual source of medical care, particularly in southern states that have not expand Medicaid [21, 22].
Integration of PrEP into new settings (such as family planning clinics) requires understanding of organizational context and potential obstacles to implementation . To identify contextual factors related to implementation, theory-driven pre-implementation assessments, which employ surveys and interviews with clinical stakeholders, can provide critical insight into organizational context and capacity to implement evidence-based interventions (EBIs), such as PrEP. In prior work, we identified correlates of PrEP implementation capacity in Title X clinics, which included available resources (i.e., time, funding, and staffing), leadership engagement, implementation climate, and provider attitudes about PrEP . Identifying barriers prior to adoption is critical, so that implementation plans, or “blueprints” for adoption of EBIs, can delineate strategies for overcoming known obstacles to implementation .
In addition to identifying key correlates of implementation capacity, implementation planning should also account for contextual variation between clinics [26,27,28]. Because healthcare settings (such as Title X clinics) can exhibit significant heterogeneity in organizational context and barriers to EBI implementation, “blueprints” may need to be tailored to each organization’s unique needs. For instance, clinical settings have shown wide variation in provider-level attitudes towards EBIs , organizational-level implementation climate , and systems-level policies and funding structures [31, 32]. Because of this variation, a “one-size-fits-all” approach to implementation planning may not support successful implementation of EBIs, such as PrEP.
In this study, we present a method for systematically capturing the contextual variation or heterogeneity in implementation determinants across healthcare organizations. Through the use of latent profile analysis (LPA) [33, 34], we identified sub-groups of Title X family planning clinics in the South, that each have unique profiles of implementation determinants (based on constructs from the Consolidated Framework for Implementation Research (CFIR) ). Identification of clinic sub-groups and their unique strengths/gaps allows researchers to better tailor implementation strategies and “blueprints” to the unique context of each group. Therefore, the objectives of this research are (1) identify sub-groups of Title X clinics based on their unique profiles of implementation determinants and (2) assess how sub-group membership is related to readiness for implementation of PrEP.
Study design and population
We invited healthcare providers and clinic administrators from Title X-funded family planning clinics in Department of Health and Human Services (DHHS) Regions III, IV, and VI to participate in an online survey from February through June 2018. These regions include states that comprise the Southern US including Alabama, Arkansas, Delaware, District of Columbia, Florida, Georgia, Kentucky, Louisiana, Maryland, Mississippi, New Mexico, North Carolina, Oklahoma, Pennsylvania, South Carolina, Tennessee, Texas, Virginia, and West Virginia. Providers were defined as individuals who have the potential ability to prescribe, counsel, or screen for PrEP. Clinic administrators were individuals who served in an administrative oversight capacity over the Title X activities in their clinic.
A comprehensive overview of the study’s protocol, methods, and measures has been published elsewhere . In brief, quantitative surveys took place online with the assistance of the National Clinical Training Center for Family Planning (NCTCFP). The survey was emailed to the Title X clinic listserv for DHHS Regions III, IV, and VI, and listserv members received one to two email reminders per month. An advertisement for the survey was also posted on the NCTCFP website, and the survey was promoted though engagement with state Title X grant holders and through in-person recruitment at the biannual NCTCFP national meetings for Title X providers. The survey took approximately 15–25 min to complete, and participants received a $30 incentive. Institutional Review Boards from Emory University and University of North Carolina approved the study protocol prior to data collection (see Additional File 1 for STROBE checklist).
A comprehensive overview of all measures as well as the full survey instrument are described elsewhere . The survey assessed implementation determinants (from CFIR), readiness for PrEP implementation, and clinic and demographic characteristics. CFIR measures were selected based on a review of the PrEP implementation literature (to determine which implementation determinants are most relevant to PrEP) as well as discussions with Title X clinic providers, PrEP experts, and implementation scientists. Survey items were adapted from existing, validated measures of CFIR constructs [6, 37,38,39] or developed by our study team using CFIR-specific tools . Prior to launching the survey, it was piloted with a small sample of Title X clinic providers and administrators. Pilot participants were interviewed about their experience taking the interview: their feedback was used to revise the survey and ensure questions were relevant and relatable to the focal population. We describe all of the measures below in detail. Table 1 also describes each construct and the associated survey items.
Implementation determinants selected for this study are based on constructs from CFIR , which provides a menu of 39 constructs that can be used as a practical guide for systematically assessing potential barriers and facilitators in preparation for implementing PrEP. Because it is often not practical or necessary to assess all constructs in a single study, evaluations typically focus on a subset of constructs . Constructs for this analysis were selected based on their likelihood of (1) being a potential barrier (or facilitator) to PrEP implementation (as identified from the literature on PrEP implementation), and (2) having sufficient variation across clinics. For this analysis, nine different CFIR constructs were considered. The constructs covered four CFIR domains, including (1) intervention characteristics (i.e., complexity, relative advantage, and cost), individual characteristics (i.e., staff’s attitudes), inner setting factors (i.e., implementation climate, compatibility, leadership engagement, and available resources), and outer setting factors (i.e., cosmopolitanism) (Table 1). All CFIR-related survey items were evaluated on a 5-point Likert scale (1 = strongly disagree to 5 = strongly agree). Composite scores for each construct were calculated by taking the average of the contributing survey items. Most implementation determinants were adapted from validated measures (i.e., complexity, relative advantage, cost, implementation climate, leadership engagement, available resources, and PrEP attitudes) [6, 37,38,39]. Other measures that did not have validated scales (i.e., compatibility and cosmopolitanism) were developed by the study team based on CFIR definitions. Based on the results of our study, scales showed moderate to good internal consistency (Cronbach’s alpha: cost = 0.62, attitudes = 0.82, implementation climate = 0.83, compatibility = 0.88, leadership engagement = 0.90, available resources = 0.83).
Readiness for PrEP implementation
The primary outcome for this study is readiness for implementation of PrEP, which was measured based on steps of the PrEP delivery cascade (i.e., step 1, HIV risk assessment; step 2, PrEP education; step 3, PrEP eligibility assessment; step 4, PrEP prescription; and step 5, PrEP follow-up and monitoring) that the clinic could confidently implement. This measure is derived as a composite score based on the 22 or 19 (provider vs. administrator versions) survey items. The measure was developed by the study team since there were no previously-validated PrEP-specific measures of implementation readiness (survey items are depicted in Table 1). Responses to each of the survey items follow a Likert scale (1 = strongly disagree to 5 = strongly agree). Readiness for PrEP implementation was defined as the average score from the contributing survey items. Based on results of our study, the measure had high internal consistency (Cronbach’s alpha = 0.92).
Demographic and clinic/county characteristics
Individual and clinic-level characteristics were also assessed in the survey. Individual-level characteristics included self-reported age, race (white or non-white), ethnicity (Latinx or not Latinx), role (administrator or provider), years in role, and ability to prescribe medicine (yes or no). Clinic-level characteristics included metropolitan location (yes or no), pharmacy on-site (yes or no), staff to provide insurance support on-site (yes or no), and presence of primary care services (yes or no). Clinic metropolitan status was defined using the 2013 NCHS urban-rural classification scheme for counties, where metropolitan (urban) includes large central, fringe metro, medium metro, and small metro; and non-metropolitan (rural) includes micropolitan and noncore counties . Additionally, clinic county characteristics included: HIV prevalence (per 100,000), percent of population under 200% of the federal poverty level, percent uninsured, percent White, percent Hispanic, and percent of women aged 15 to 44 (childbearing age) based on AIDSVu  and US Census data .
There were 742 individuals who agreed to complete the survey. Of those, 519 (69.9%) respondents sufficiently completed the survey to warrant inclusion in our analyses. Our analyses used data from all surveys that met a minimal criteria for completeness (i.e., the respondent had to provide at least one response to questions related to PrEP use in their clinic). For the purposes of this pre-implementation analysis, the sample was restricted to clinics where PrEP was not currently being prescribed. Therefore, our sample included 414 participants from 227 non-PrEP prescribing Title X clinics. On average, there were 1.8 (range 1–12) participants per clinic. Clinic addresses were geocoded to identify participants residing in the same clinic, and each participant and clinic were given a unique identification number. Procedures for geocoding clinics have been described elsewhere .
Descriptive statistics were performed on all survey items (means (SD) or counts (%)). Pearson correlations were performed between all CFIR constructs to test for multicollinearity (see Additional File 2 for correlation matrix). Most CFIR measures were significantly correlated with each other; however, there were no strong correlations (all Pearson correlation coefficients are < |0.50|), so multicollinearity was not a major concern. The number of missing observations per variable ranged from 0 to 35. We used a non-parametric missing value imputation for mixed-type data (i.e., continuous and categorical) to impute missing values for all variables described above (including CFIR constructs, readiness for PrEP implementation, and demographics and clinic/county characteristics) (see “missForest” package for R ).
Using the nine CFIR constructs (complexity, relative advantage, cost, attitudes, implementation climate, compatibility, leadership engagement, available resources, and cosmopolitanism), LPA was performed in R using the “TidyLPA” package , to determine if Title X clinic providers and administrators coalesced into distinct sub-groups. LPA is a statistical method for dividing a population into mutually exclusive and exhaustive groups (or “latent profiles”). LPA identifies discrete groups of participants that share similar response patterns to a set of measures [33, 34]. Specifically, in this study, group membership is inferred based on participants’ response patterns to a set of CFIR constructs.
We investigated LPA solutions with one to ten groups. A one group solution would assume that all providers and administrators had similar perceptions across all CFIR measures, which was unlikely, and we assumed that solutions with more than 10 groups would have produced groups that were too small for generalization. To select the number of groups that fit the data best, we used four statistical metrics as well as interpretability of the groups. We considered solutions with high entropy levels (values > 0.80 indicate a high level of separation between the groups ), significant p-values for the bootstrap likelihood ratio test (BLRT) (which tests if the model performs significantly better than the K−1 group solution), and comparatively low AIC and BIC values. Simulation studies have shown that BIC and BLRT perform most reliably in latent profile analyses .
Based on the probabilities of class membership, each participant was assigned to a group they were most likely to belong. To understand the composition of each group, bivariate analyses were performed between group membership and individual/clinic-level characteristics (chi-squared was used for categorical variables and one-way ANOVA for continuous variables). We then conducted a random-intercept, multi-level model to test whether group membership predicted readiness for implementation of PrEP. This analysis modeled the nesting of participants within clinics. We fit the model to our data with SAS PROC GLMMIX using maximum likelihood estimation. The model controlled for variables that were significant in bivariate analyses (i.e., ability to prescribe medication, race, provision of primary care, racial/ethnic composition of county, county HIV prevalence, and percentage of women of childbearing age in the county).
Of the 414 participants, the mean age was 45.92 (SD = 11.22) years. Participants were predominately White (n = 311, 75.12%) and most were clinic providers (n = 351, 84.78%). The mean number of years serving in their current role was 8.58 (SD = 7.89). Many clinics were located in metropolitan areas (n = 293, 70.77%) with high prevalence of HIV (mean = 459.78 cases/100,000, SD = 512.89 cases/100,000). See Table 2 for additional characteristics of the sample.
Latent group membership
Based on entropy, BIC, AIC, BLRT, and interpretability, we selected the 6-group model (entropy = 0.81, AIC = 7880.3, BIC = 8154.1, BLRT p-value = 0.009) (see Additional File 3 for fit metrics for 1- to 10-group solutions). The 6-group model had high separation between groups (entropy > 0.80), the lowest BIC value, and significant BLRT p-value, indicating that the model performed significantly better than the 5-group solution. The 7-group solution had a lower AIC value compared to the six group model; however, we believed that the 7-group model was less interpretable and had small within-group sample sizes. We consulted with PrEP experts and interviewed Title X family planning providers and administrators to ensure that the 6-group solution was interpretable from a practice-based perspective. Below we describe each of the 6 different groups: (1) Highest Capacity for Implementation, (2) Favorable Conditions for Implementation, (3) Mixed Implementation Context, (4) Neutral Implementation Context, (5) Incompatible Setting for Implementation, and (6) Resource-Strained Setting (see Fig. 1 and Table 2).
Group 1: Highest capacity for implementation
Compared to all other groups, the High Capacity group (n = 17) had the highest scores across many implementation determinants, suggesting that this group has the best capacity for PrEP implementation (Fig. 1). Specifically, the inner and outer setting CFIR constructs all had mean scores above 4 (on a 5-point scale). Scores for inner setting factors indicate that these clinics highly value PrEP and HIV prevention (implementation climate mean = 4.04, SD = 0.56), believe that PrEP is compatible with their patient population (compatibility mean = 4.59, SD = 0.52), believe that their clinic leaders are highly supportive of adopting new practices (leadership engagement mean = 4.59, SD = 0.48), and have a high level of resources that could be dedicated to PrEP implementation (available resources mean = 4.32, SD = 0.64). Additionally, in the outer setting, they are highly networked with external HIV organizations (cosmopolitanism mean = 4.65, SD = 0.49). They also perceived PrEP implementation to have the lowest complexity (mean = 1.71, SD = 0.69) compared to other groups. Notably, this group included clinics that were most commonly from metropolitan areas, which had significantly higher HIV prevalence rates, higher levels of poverty, and higher proportion of minority residents compared to any other group. Nearly all of these clinics had insurance support on-site, and participants in this group tended to have less experience in their role and were more likely to be non-White (Table 2).
Group 2: Favorable conditions for implementation
This group (n = 105) had the second-most favorable profile compared to the High Capacity group (Fig. 1). Although the Favorable group scored relatively high, averages for the inner and outer setting constructs were nearly a full point lower than the High Capacity group (Table 2). Specifically, this group had the second-highest scores for implementation climate (mean = 3.74, SD = 0.56), compatibility (4.20, SD = 0.43), and available resources (3.04, SD = 0.65). In the intervention characteristics domain, this group had the lowest scores for cost (mean = 2.87, SD = 0.44), suggesting that they do not perceive the cost of PrEP to be a major barrier to implementation. They also believe PrEP would be easy to implement (second-lowest complexity score, mean = 2.67, SD = 0.91), and they are not concerned about providing PrEP to their clients (second-lowest concerned attitudes, mean = 2.09, SD = 0.45). Most of these clinics have insurance support on-site and are located in metropolitan areas with a high prevalence of HIV (Table 2).
Group 3: Mixed implementation context
Compared to the High Capacity and Favorable groups which had good scores across all implementation determinants, the Mixed Context group (n = 53) had both strengths and weaknesses (Fig. 1). Strengths included having the highest relative advantage score across all groups (mean = 3.85, SD = 0.74), suggesting that offering PrEP would be better than their current HIV prevention practices. This group also has strong connections to external HIV organizations (cosmopolitanism mean = 4.26, SD = 0.68), as well as appears to value HIV prevention (implementation climate mean = 3.58, SD = 0.60) and believes PrEP is well-suited for their patient population (compatibility mean = 3.97, SD = 0.45). However, the high complexity of offering PrEP (complexity mean = 3.83, SD = 0.72), high cost of PrEP (cost mean = 3.89, SD = 0.43), and lack of available resources for implementation (available resources mean = 2.42, SD = 0.67) could be barriers to adoption in this group. Many of the individuals in this group have the ability to prescribe medication, and this group has the highest percentage of clinics that have a pharmacy on-site.
Group 4: Neutral implementation context
This group (n = 201) had very average scores across all of the CFIR-related determinants of implementation (means ranged from 2.9 to 3.77) (Fig. 1). Compared to the other groups, it does not have strong strengths or strong weaknesses. Though, it has the second-highest score for leadership engagement (mean = 3.61, SD = 0.70), and clinic administrators most commonly fell in this group. Notably, clinics that provided primary care were most likely to be in this group, and most of these clinics had insurance support on-site. Compared to the aforementioned groups, the Neutral group had a higher representation of non-metropolitan communities, which had lower HIV prevalence rates and more White residents (Table 2).
Group 5: Incompatible setting for PrEP implementation
The Incompatible group (n = 26) had the lowest scores for many of the implementation determinants, especially in the Intervention Characteristics and Characteristics of Individuals domains (Fig. 1). Compared to all other groups, they had the most negative attitudes about PrEP (concerned attitudes mean = 3.04, SD = 0.42), and they were concerned that PrEP would be too hard to offer in their clinic (complexity mean = 4.27, SD = 0.60) and would be too costly (cost mean = 3.85, SD = 0.56). This group was also most concerned that PrEP did not align with the needs of their clients (compatibility mean = 2.58, SD = 0.63), and they did not think it had an advantage for their patients (relative advantage mean = 2.23, SD = 0.76). This group had the highest representation of clinics from non-metropolitan areas, which had the lowest HIV prevalence rates (Table 2).
Group 6: Resource-strained setting
Lastly, the Resource-Strained group (n = 12) noted major obstacles in the Inner Setting and Outer Settings domains (Fig. 1). Specifically, this group had the lowest resources for implementation (available resources mean = 1.58, SD = 0.73), most unsupportive leadership (leadership engagement mean = 1.42, SD = 0.59), worst climate for implementation (mean = 2.30, SD = 0.70), and lack of partnerships with external HIV organizations (cosmopolitanism mean = 1.75, SD = 0.87). Because of these major barriers, they also thought PrEP would be too complex to implement in their clinic (complexity mean = 4.08, SD = 0.99). However, in striking opposition to the Incompatible group, the Resource-Strained group had least concerned attitudes about PrEP (mean = 1.85, SD = 0.47), compared to any other group. They also believe PrEP would be highly advantageous (relative advantage mean = 3.50, SD = 1.24) and would be a great benefit to their clients (compatibility mean = 4.11, SD = 0.73). The individuals in this group had the most years of experience, and the majority of these participants were able to prescribe medication. Clinics in this group were commonly from metropolitan areas with a high prevalence of HIV (Table 2).
Readiness for implementation and group membership
Compared to the Neutral group, the Highest Capacity (B = 0.86, SE = 0.13, p < 0.0001) and Favorable (B = 0.40, SE = 0.07, p < 0.0001) groups had significantly higher levels of implementation readiness; and the Resource-Strained group (B = − 0.61, SE = 0.17, p = 0.0003) had significantly lower levels of implementation readiness (see Fig. 2, full results of the multi-level model are presented in Additional File 4). The ICC was 0.34, indicating that 34% of the variation in readiness for implementation of PrEP was at the clinic-level.
LPA is a useful method for capturing the variation in implementation context and barriers to adoption of new practices across sites. In this study, we identified six different sub-groups of Title X-funded family planning providers and administrators in the Southern US that have unique profiles of barriers and facilitators to PrEP implementation. Two groups (“Highest Capacity” and “Favorable Conditions”) showed significantly increased levels of readiness for implementation while one group (“Resource-Strained”) showed significantly reduced levels of readiness for implementation of PrEP. To enhance the likelihood of PrEP implementation success in each of these groups, we can employ tailored implementation strategies for overcoming identified weaknesses and leveraging strengths [26, 47, 48].
Both the “Highest Capacity” and “Favorable” groups (encompassing about 30% of the sample (n = 122)) have high scores across implementation determinants related to the intervention (i.e., PrEP), the clinic, the individuals working within the clinic, and the clinic’s external network. These clinics are also commonly located in metropolitan areas with the highest HIV prevalence rates, suggesting that they have an opportunity to reach a particularly at-risk population. These may be ideal clinics to begin the roll-out of PrEP services, since their context is likely able to support PrEP implementation. However, we suggest that all clinics, prior to PrEP implementation, receive a training on the process for conducting the PrEP cascade (i.e., HIV risk assessment, PrEP patient education, assessing patient eligibility for PrEP, PrEP prescription, and PrEP follow-up care) to ensure that clinic staff, providers, and administrators are informed of necessary requirements. We have previously shown that a 1 hour training is able to significantly increase providers’ PrEP knowledge, attitudes, and skills .
However, the remainder of the groups may need additional implementation strategies beyond training. For instance, the “Mixed Context” group (n = 53, 12.8%), although they believe PrEP offers advantages over their current HIV prevention services, perceives the cost of PrEP to be a major obstacle to implementation. This is understandable as the South has a high proportion of uninsured patients and many states have not expanded Medicaid , which can hinder the affordability of PrEP for low-income and vulnerable patients. To overcome cost hurdles, there are some services in place, such as HHS’s “Ready, Set, PrEP” Program and Gilead’s Advancing Access Program, which cover the cost of PrEP prescriptions for uninsured patients. Gilead also has a co-pay program to help insured patients cover the cost of co-pays and deductibles for PrEP services. Many of the “Mixed Context” clinics already have staff on site that assist patients with insurance enrollment (75%), and these insurance navigators should receive education on procedures for enrolling patients in these PrEP payment assistance programs. Additionally, clinics that are concerned about the cost of PrEP and have limited financial resources can also consider pursuing grant funding for PrEP services, as this has been a facilitator for implementation in other family planning clinics [15, 51].
Furthermore, for successful PrEP implementation to occur in the “Incompatible Setting” and “Resource-Strained” groups, which represent about 9% of the sample (n = 38), significant amounts of system strengthening as well as building a “business case” for PrEP delivery are likely needed. Specifically, the “Incompatible Setting” group had the most negative attitudes about PrEP and perceived that PrEP was not compatible with the needs of their patient population. Clinics in this group were more likely to be located in non-metropolitan communities with the lowest rates if HIV (compared to other groups), so HIV prevention may be less of a priority for these providers. However, these negative attitudes about PrEP are concerning, given that the Southern US is the current epicenter of the HIV epidemic . Providers and staff in this group may require additional education on the prevalence and impacts of HIV to overcome knowledge/attitude barriers. In addition, the “Incompatible Setting” group believed that PrEP implementation was too complex. Although there is limited guidance on strategies to combat issues related to complexity, expert recommendations suggest that “promoting adaptability” may work for these settings . Promoting adaptability requires tailoring the intervention (i.e., PrEP) to the site’s needs . For instance, our research in family planning clinics has shown that some clinics have decided to provide the initial steps of the PrEP cascade (HIV risk assessment and PrEP patient education) and then refer patients to external providers for PrEP prescriptions and continued care [15, 51]. Clinics in the “Incompatible Setting” group may consider this referral adaption, so that women who could benefit from PrEP are at a minimum educated and made aware of the availability of PrEP services in their community. Universal education pertaining to PrEP is especially important given consistently low knowledge and awareness about PrEP reported among women in the South [5, 7]. Other potential adaptations to PrEP, that could help overcome barriers, include pharmacy-based PrEP services (which could be useful for clinics that have a pharmacy on-site) , telemedicine , and at-home PrEP services .
However, in the “Resource-Strained” group it may be unlikely that any PrEP services could be offered without significant additional internal and external systems changes. This group has clinic characteristics (low implementation climate, available resources, leadership engagement) that are very unfavorable for successful implementation. They also have very low cosmopolitanism scores, suggesting that even the adaptation strategy would be ineffective, since they do not have relationships with external HIV organizations where they could refer patients. Not only would these clinics need to build partnerships with external HIV organizations and PrEP providers, they would also need to identify strong champions to lead the adoption of PrEP services in their clinic (to overcome climate and leadership weaknesses) and pursue grant funding (to overcome cost and resource barriers) .
Future research should focus on the provision of these tailored implementation plans to each sub-group of clinics. Evaluations would yield important data on the success of these implementation strategies to promote PrEP adoption and sustained delivery in each clinic sub-group. Limitations of this study include the use of a non-probability sampling method and self-reported data (i.e., not based on observations of clinical context). Additionally, some of the groups had small within-group sample sizes, so these groups may not generalize to the larger population of Title X clinics. Furthermore, we were unable to examine all CFIR constructs. CFIR is comprised of 39 different constructs and although our survey captured many of these, we were unable to utilize all constructs in the LPA. If too many constructs are included in this analysis, it can become difficult to interpret; therefore, we selected nine CFIR constructs that we hypothesized to have the greatest impact on PrEP implementation as well as the greatest variability across clinical settings. These decisions were made based on a review of the PrEP implementation literature and discussions with experts in implementation science and HIV prevention as well as clinical providers. Despite limitations, the LPA approach may be especially helpful for large public health systems, like the Title X Family Planning Program, which provides funding for the provision of family planning and other preventative health services for un-/under-insured individuals through a network of approximately 4000 clinical sites across the US. Learning if there are systematic differences within the network that could support more tailored implementation planning might allow for these networks to more easily scale interventions across sites, especially when interventions may be required at the Title X level.
In conclusion, we identified six different groups of Title X family planning clinics, based on their profiles of determinants of PrEP implementation. Some groups had very favorable scores across the implementation determinants as well as high readiness for implementation, suggesting an ideal environment for roll-out of PrEP services. Other groups, with identified contextual weaknesses, would likely need system strengthening prior to PrEP implementation along with tailored implementation strategies to overcome barriers to successful PrEP implementation. LPA has important implications for engaging with complexity in implementation research and understanding the contextual variation across sites. This method also promotes identification of sub-groups, allowing implementation planning to be tailored to the specific needs of unique segments of this diverse network of clinical sites comprising the Title X family planning safety net system.
Availability of data and materials
The datasets analyzed during the current study are available from the corresponding author on reasonable request.
Akaike information criterion
Bayesian information criterion
Bootstrap likelihood ratio test
Consolidated framework for implementation research
Human immunodeficiency virus
Latent profile analysis
National clinical training center for family planning
United States department of health and human services
Centers for Disease Control and Prevention. HIV surveillance report. 2017.
Centers for Disease Control Prevention. CDC issue brief: HIV in the Southern United States. 2016.
Fonner VA, Dalglish SL, Kennedy CE, Baggaley R, O’reilly KR, Koechlin FM, et al. Effectiveness and safety of oral HIV preexposure prophylaxis for all populations. AIDS. 2016;30(12):1973.
US Food Drug Administration. FDA approves first drug for reducing the risk of sexually acquired HIV infection. 2012.
Patel AS, Goparaju L, Sales JM, Mehta CC, Blackstock OJ, Seidman D, et al. PrEP eligibility among at-risk women in the Southern United States: associated factors, awareness, and acceptability. J Acquir Immune Defic Syndr. 2019;80(5):527.
Seidman D, Carlson K, Weber S, Witt J, Kelly PJ. United States family planning providers' knowledge of and attitudes towards preexposure prophylaxis for HIV prevention: a national survey. Contraception. 2016;93(5):463–9. https://doi.org/10.1016/j.contraception.2015.12.018.
Sales JM, Phillips AL, Tamler I, Munoz T, Cwiak C, Sheth AN. Patient recommendations for PrEP information dissemination at family planning clinics in Atlanta, Georgia. Contraception. 2019;99(4):233–8. https://doi.org/10.1016/j.contraception.2018.12.008.
Calabrese SK, Dovidio JF, Tekeste M, Taggart T, Galvao RW, Safon CB, et al. HIV pre-exposure prophylaxis stigma as a multidimensional barrier to uptake among women who attend planned parenthood. J Acquir Immune Defic Syndr. 2018;79(1):46.
Sullivan PS, Mouhanna F, Mera R, Pembleton E, Castel AD, Jaggi C, Jones J, Kramer MR, McGuinness P, McCallister S, Siegler AJ. Methods for county-level estimation of pre-exposure prophylaxis coverage and application to the US Ending the HIV Epidemic jurisdictions. Ann Epidemiol. 2020;44:16–30.
Sullivan PS, Giler RM, Mouhanna F, Pembleton ES, Guest JL, Jones J, et al. Trends in the use of oral emtricitabine/tenofovir disoproxil fumarate for pre-exposure prophylaxis against HIV infection, United States, 2012–2017. Ann Epidemiol. 2018;28(12):833–40. https://doi.org/10.1016/j.annepidem.2018.06.009.
Smith DK, Van Handel M, Grey J. Estimates of adults with indications for HIV pre-exposure prophylaxis by jurisdiction, transmission risk group, and race/ethnicity, United States, 2015. Ann Epidemiol. 2018;28(12):850–7 e9.
Ya-lin AH, Zhu W, Smith DK, Harris N, Hoover KW. HIV preexposure prophylaxis, by race and ethnicity—United States, 2014–2016. Morb Mortal Wkly Rep. 2018;67(41):1147.
Siegler AJ, Mouhanna F, Giler RM, Weiss K, Pembleton E, Guest J, et al. The prevalence of pre-exposure prophylaxis use and the pre-exposure prophylaxis–to-need ratio in the fourth quarter of 2017, United States. Ann Epidemiol. 2018;28(12):841–9. https://doi.org/10.1016/j.annepidem.2018.06.005.
Siegler AJ, Bratcher A, Weiss KM. Geographic access to preexposure prophylaxis clinics among men who have sex with men in the United States. Am J Public Health. 2019;109(9):1216–23. https://doi.org/10.2105/AJPH.2019.305172.
Sales J, Piper K, Escoffery C, Sheth A. 3. Where can Southern girls go for prep? Examining the prep-providing practices of Title-X funded family planning clinics across the Southern US. J Adolesc Health. 2020;66(2):S2.
Fauci AS, Redfield RR, Sigounas G, Weahkee MD, Giroir BP. Ending the HIV epidemic: a plan for the United States. Jama. 2019;321(9):844–5. https://doi.org/10.1001/jama.2019.1343.
Auerbach JD, Kinsky S, Brown G, Charles V. Knowledge, attitudes, and likelihood of pre-exposure prophylaxis (PrEP) use among US women at risk of acquiring HIV. AIDS Patient Care STDs. 2015;29(2):102–10. https://doi.org/10.1089/apc.2014.0142.
Stormo AR, Saraiya M, Hing E, Henderson JT, Sawaya GF. Women’s clinical preventive services in the United States: who is doing what? JAMA Intern Med. 2014;174(9):1512–4. https://doi.org/10.1001/jamainternmed.2014.3003.
Department of Health and Human Services. Program requirements for title X funded family planning projects. https://www.hhs.gov/opa/guidelines/program-guidelines/program-requirements/index.html. Accessed 28 Apr 2021.
Fowler C, Gable J, Wang J. Family Planning Annual Report: 2005 national summary: Research Triangle Institute International; 2006.
Frost JJ, Gold RB, Bucek A. Specialized family planning clinics in the United States: why women choose them and their role in meeting women's health care needs. Womens Health Issu. 2012;22(6):e519–e25. https://doi.org/10.1016/j.whi.2012.09.002.
Jones RK, Sonfield A. Health insurance coverage among women of reproductive age before and after implementation of the affordable care act. Contraception. 2016;93(5):386–91. https://doi.org/10.1016/j.contraception.2016.01.003.
Flottorp SA, Oxman AD, Krause J, Musila NR, Wensing M, Godycki-Cwirko M, et al. A checklist for identifying determinants of practice: a systematic review and synthesis of frameworks and taxonomies of factors that prevent or enable improvements in healthcare professional practice. Implementation Sci. 2013;8(1):35. https://doi.org/10.1186/1748-5908-8-35.
Sales J, Escoffery C, Hussen S, Haddad L, McCumber M, Kwiatkowski E, et al. Pre-exposure prophylaxis implementation in family planning services across the Southern United States: findings from a survey among staff, providers and administers working in Title X-funded clinics. AIDS Behav. 2021. https://doi.org/10.1007/s10461-020-03120-9.
Waltz TJ, Powell BJ, Chinman MJ, Smith JL, Matthieu MM, Proctor EK, et al. Expert recommendations for implementing change (ERIC): protocol for a mixed methods study. Implementation Sci. 2014;9(1):39. https://doi.org/10.1186/1748-5908-9-39.
Powell BJ, Beidas RS, Lewis CC, Aarons GA, McMillen JC, Proctor EK, et al. Methods to improve the selection and tailoring of implementation strategies. J Behav Health Serv Res. 2017;44(2):177–94. https://doi.org/10.1007/s11414-015-9475-6.
Powell BJ, Fernandez ME, Williams NJ, Aarons GA, Beidas RS, Lewis CC, et al. Enhancing the impact of implementation strategies in healthcare: a research agenda. Front Public Health. 2019;7:3. https://doi.org/10.3389/fpubh.2019.00003.
Wensing M, Bosch M, Grol R. Selecting, tailoring, and implementing knowledge translation interventions. Knowl Translat Health Care Moving Evid Pract. 2009;94:113.
Aarons GA, Cafri G, Lugo L, Sawitzky A. Expanding the domains of attitudes towards evidence-based practice: the evidence based practice attitude scale-50. Adm Policy Ment Health Ment Health Serv Res. 2012;39(5):331–40. https://doi.org/10.1007/s10488-010-0302-3.
Jacobs SR, Weiner BJ, Bunger AC. Context matters: measuring implementation climate among individuals and groups. Implementation Sci. 2014;9(1):46. https://doi.org/10.1186/1748-5908-9-46.
Ganju V. Implementation of evidence-based practices in state mental health systems: Implications for research and effectiveness studies. Schizophr Bull. 2003;29(1):125–31. https://doi.org/10.1093/oxfordjournals.schbul.a006982.
Raghavan R, Bright CL, Shadoin AL. Toward a policy ecology of implementation of evidence-based practices in public mental health settings. Implementation Sci. 2008;3(1):26. https://doi.org/10.1186/1748-5908-3-26.
Jason L, Glenwick D. Handbook of methodological approaches to community-based research: qualitative, quantitative, and mixed methods. Oxford: Oxford university press; 2016.
Oberski D. Mixture Models: Latent Profile and Latent Class Analysis. In: Robertson J., Kaptein M. (eds) Modern Statistical Methods for HCI. Human–Computer Interaction Series. Cham: Springer; 2016. https://doi.org/10.1007/978-3-319-26633-6_12.
Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implementation Sci. 2009;4(1):50. https://doi.org/10.1186/1748-5908-4-50.
Sales JM, Escoffery C, Hussen SA, Haddad LB, Phillips A, Filipowicz T, et al. Pre-exposure prophylaxis integration into family planning services at Title X clinics in the Southeastern United States: a geographically-targeted mixed methods study (Phase 1 ATN 155). JMIR Res Protoc. 2019;8(6):e12774. https://doi.org/10.2196/12774.
Norton WE. An exploratory study to examine intentions to adopt an evidence-based HIV linkage-to-care intervention among state health department AIDS directors in the United States. Implementation Sci. 2012;7(1):1–8.
Ehrhart MG, Aarons GA, Farahnak LR. Assessing the organizational context for EBP implementation: the development and validity testing of the Implementation Climate Scale (ICS). Implementation Sci. 2014;9(1):1–11.
Helfrich CD, Li Y-F, Sharp ND, Sales AE. Organizational readiness to change assessment (ORCA): development of an instrument based on the Promoting Action on Research in Health Services (PARIHS) framework. Implementation Sci. 2009;4(1):1–13.
Ingram DD, Franco SJ. 2013 NCHS urban–rural classification scheme for counties. National Center for Health Statistics. Vital Health Stat. 2014;2(166). https://www.cdc.gov/nchs/data_access/urban_rural.htm. Accessed 28 Apr 2021.
Whittaker JK, Holmes L, del Valle JF, Ainsworth F, Andreassen T, Anglin J, et al. Therapeutic residential care for children and youth: a consensus statement of the international work group on therapeutic residential care. Residential Treat Child Youth. 2016;33(2):89–106. https://doi.org/10.1080/0886571X.2016.1215755.
US Census Bureau. Profile of general population and housing characteristics: 2010. 2010.
Stekhoven DJ, Bühlmann P. MissForest—non-parametric missing value imputation for mixed-type data. Bioinformatics. 2012;28(1):112–8. https://doi.org/10.1093/bioinformatics/btr597.
Rosenberg J, van Lissa C, Beymer P, Anderson D, Schell M, Schmidt J. tidyLPA: Easily carry out latent profile analysis (LPA) using open-source or commercial software [R package]. 2019.
Celeux G, Soromenho G. An entropy criterion for assessing the number of clusters in a mixture model. J Classif. 1996;13(2):195–212. https://doi.org/10.1007/BF01246098.
Nylund KL, Asparouhov T, Muthén BO. Deciding on the number of classes in latent class analysis and growth mixture modeling: a Monte Carlo simulation study. Struct Equation Model Multidisciplinary J. 2007;14(4):535–69. https://doi.org/10.1080/10705510701575396.
Waltz TJ, Powell BJ, Fernández ME, Abadie B, Damschroder LJ. Choosing implementation strategies to address contextual barriers: diversity in recommendations and future directions. Implementation Sci. 2019;14(1):42. https://doi.org/10.1186/s13012-019-0892-4.
Proctor EK, Powell BJ, McMillen JC. Implementation strategies: recommendations for specifying and reporting. Implementation Sci. 2013;8(1):139. https://doi.org/10.1186/1748-5908-8-139.
Sales JM, Cwiak C, Haddad LB, Phillips A, Powell L, Tamler I, et al. Brief report: impact of PrEP training for family planning providers on HIV prevention counseling and patient interest in PrEP in Atlanta,Georgia. J Acquir Immune Defic Syndr. 2019;81(4):414–8. https://doi.org/10.1097/QAI.0000000000002057.
Berchick ER, Hood E, Barnett JC. Health insurance coverage in the United States: 2017. Current population reports. Washington DC: US Government Printing Office; 2018.
Piper KN, Escoffery C, Sales JM, Sheth AN. Models of HIV pre-exposure prophylaxis care used in Title X family planning clinics in the southern US. J Adolesc Health. 2021;68(3):480–7.
Tung EL, Thomas A, Eichner A, Shalit P. Implementation of a community pharmacy-based pre-exposure prophylaxis service: a novel model for pre-exposure prophylaxis care. Sex Health. 2018;15(6):556–61. https://doi.org/10.1071/SH18084.
Hoth AB, Shafer C, Dillon DB, Mayer R, Walton G, Ohl ME. Iowa TelePrEP: a public-health-partnered telehealth model for human immunodeficiency virus preexposure prophylaxis delivery in a rural state. Sex Transm Dis. 2019;46(8):507–12. https://doi.org/10.1097/OLQ.0000000000001017.
Siegler AJ, Mayer KH, Liu AY, Patel RR, Ahlschlager LM, Kraft CS, et al. Developing and assessing the feasibility of a home-based preexposure prophylaxis monitoring and support program. Clin Infect Dis. 2019;68(3):501–4. https://doi.org/10.1093/cid/ciy529.
This research was supported by the NIH-funded Adolescent Medicine Trials Network for HIV/AIDS Interventions (ATN) grant U24HD089880. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.
Ethics approval and consent to participate
Approval to conduct the study was gained from Emory University and University of North Carolina Institutional Review Boards.
Consent for publication
All participants provided consent before participating in the survey.
JS and AS received grant funding from Gilead Sciences, Inc., to Emory University for unrelated work.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Additional file 1:.
STROBE Statement—Checklist of items that should be included in reports of cross-sectional studies
Additional file 2:
Pearson correlations between CFIR constructs (n=414)
Additional file 3:.
Model fit metrics
Additional file 4:.
Results of multi-level model predicting readiness for implementation of PrEP
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Piper, K.N., Haardörfer, R., Escoffery, C. et al. Exploring the heterogeneity of factors that may influence implementation of PrEP in family planning clinics: a latent profile analysis. Implement Sci Commun 2, 48 (2021). https://doi.org/10.1186/s43058-021-00148-3
- Implementation science
- Family planning
- Consolidated Framework for Implementation Research
- Latent profile analysis