- Open Access
Provider perspectives on clinical decision support to improve HIV prevention in pediatric primary care: a multiple methods study
Implementation Science Communications volume 4, Article number: 18 (2023)
Clinical decision support (CDS) is a promising intervention for improving uptake of HIV testing and pre-exposure prophylaxis (PrEP). However, little is known regarding provider perspectives on acceptability, appropriateness, and feasibility of CDS for HIV prevention in pediatric primary care, a key implementation setting.
This was a cross-sectional multiple methods study utilizing surveys and in-depth interviews with pediatricians to assess acceptability, appropriateness, and feasibility of CDS for HIV prevention, as well as to identify contextual barriers and facilitators to CDS. Qualitative analysis utilized work domain analysis and a deductive coding approach grounded in the Consolidated Framework of Implementation Research. Quantitative and qualitative data were merged to develop an Implementation Research Logic Model to conceptualize implementation determinants, strategies, mechanisms, and outcomes of potential CDS use.
Participants (n = 26) were primarily white (92%), female (88%), and physicians (73%). Using CDS to improve HIV testing and PrEP delivery was perceived as highly acceptable (median score 5), IQR [4–5]), appropriate (5, IQR [4–5]), and feasible (4, IQR [3.75–4.75]) using a 5-point Likert scale. Providers identified confidentiality and time constraints as two key barriers to HIV prevention care spanning every workflow step. With respect to desired CDS features, providers sought interventions that were integrated into the primary care workflow, standardized to promote universal testing yet adaptable to the level of a patient’s HIV risk, and addressed providers’ knowledge gaps and bolstered self-efficacy in providing HIV prevention services.
This multiple methods study indicates that clinical decision support in the pediatric primary care setting may be an acceptable, feasible, and appropriate intervention for improving the reach and equitable delivery of HIV screening and PrEP services. Design considerations for CDS in this setting should include deploying CDS interventions early in the visit workflow and prioritizing standardized but flexible designs.
Despite clinical practice guidelines, HIV testing and pre-exposure prophylaxis (PrEP) remain underused in pediatric primary care. HIV testing is a critical adolescent health screening, as adolescents account for 20% of U.S. incident HIV diagnoses. Early HIV diagnosis and viral suppression with treatment dramatically lower morbidity and mortality and prevent secondary transmission. For at-risk youth who test negative for HIV, PrEP is > 90% effective in preventing HIV [1, 2]. Previous analyses have identified low HIV testing rates both relative to the overall prevalence of sexual activity and sexually transmitted infections (STI) in adolescents [3, 4]. Despite high efficacy, PrEP delivery and counseling rates also remain low, with only 16% of youth ages 16–24 with PrEP indications receiving prescriptions [2, 5,6,7] despite Centers for Disease Control and Prevention (CDC) guidelines now recommending all sexually active adolescents should be informed about PrEP .
Pediatric primary care, where most adolescents receive health services, is an ideal setting for HIV testing and PrEP delivery. However, tight schedules and competing patient needs often lead to increased provider mental workload and decreased situational awareness—an impaired ability to recognize and synthesize patient risk factors and efficiently identify the need for care [9, 10]—regarding HIV risk. In busy clinical settings, cognitive tunneling, a process by which individuals consider fewer solutions, ideas, and cues due to an inability to manage excess information, impairs decision-making . Low situational awareness in primary care can thus result in providers failing to recognize key opportunities for HIV prevention, for example, identifying the need for HIV testing for adolescents with STIs given their increased biologic and social risk . Prior research demonstrates that pediatricians are often hesitant to ask about sexual behavior, sexual orientation, and gender identity and concerned about confidentiality of this information. These essential data points are often absent in pediatric health records, although an informative history can both lead to improved delivery of HIV prevention services and cultural tailoring of services to key populations, such as young men who have sex with men (MSM) or transgender youth . This discomfort around sexual health delivery may result in lower prioritization of HIV and STI prevention within the multitude of preventive health topics addressed during the pediatric visit .
Increased mental workload also heightens implicit bias, wherein unintentionally held attitudes and beliefs affect clinical decision-making [10, 14, 15]. Inequities by gender, sexual orientation, race, sex, and socioeconomic status [16,17,18,19] exist at nearly every step of PrEP delivery, from counseling to prescription, with provider implicit bias playing a key role . Previous research demonstrates lower rates of PrEP counseling and prescription for Black men compared to White men and for cisgender women who have sex with men compared to cisgender MSM . While women ages 15–24 years old account for the vast majority of STIs [22, 23], PrEP initiation rates are substantially lower in cisgender heterosexual females compared to cisgender MSM [7, 21, 23, 24]. Data demonstrate that 10% of cisgender females with PrEP indications have been prescribed PrEP compared to 28% of cisgender males . These inequities may be further magnified in adolescents, with a recent study of adolescents with STIs finding that male sex at birth patients were 26 times more likely than female sex at birth patients to receive PrEP counseling . Within the pediatric primary care setting, given overall low rates of testing, there is thus a critical need for guideline-based HIV prevention service delivery to youth across sexes, sexual orientations, and gender identities. Given these challenges, developing methods for providers to manage information and efficiently apply relevant guidelines is a critical step to improve HIV testing and PrEP delivery in pediatric primary care.
Clinical decision support (CDS) for HIV prevention aims to aid provider decision-making, increase adherence to HIV testing and PrEP guidelines, decrease bias in guideline application, and improve efficiency and effectiveness of care delivery [9, 26]. Clinical decision support encompasses “knowledge-driven interventions that can promote safety, education, workflow improvement, communication, and improved quality of care” . Electronic and paper alerts and reminders, order sets, and guidelines are all types of CDS, providing a prompt toward evidence-based decision-making and away from biased clinical decisions. However, to be successfully implemented, CDS must be carefully designed to fit within existing workflows and users’ cognitive processes [9, 28]. The application of user-centered design in the development of CDS for primary care can help facilitate better CDS implementation and utilization .
The primary objective of this multiple methods pre-implementation study was to understand perceptions of the acceptability, appropriateness, and feasibility of electronic health record (EHR)-based CDS as an intervention to improve the equity of HIV testing and PrEP delivery in pediatric primary care. Secondarily, we aimed to identify optimal timing and describe context-specific barriers and facilitators of CDS implementation. Lastly, we sought to integrate these data to develop an Implementation Research Logic Model characterizing determinants, strategies, mechanisms, and outcomes for future implementation of CDS to improve HIV testing and PrEP delivery in pediatric primary care.
Design, setting, and participants
This cross-sectional concurrent multiple methods (QUAL + quan) study  recruited providers from four urban primary care clinics within a large pediatric academic health system based in Philadelphia, PA, USA. The clinics see > 100,000 visits annually. Over half of the families live at or below the poverty line, > 69% have Medical Assistance coverage, and ~ 70% are African American . Two of the clinics provide government-subsidized (Title X) family planning services. None offer HIV point-of-care testing, and three have in-clinic phlebotomy. Eligible participants were nurse practitioners, physician assistants, or pediatric physicians. Participants were recruited via emails sent by their practice directors describing the study’s aim and providing contact information for the Principal Investigator. Those opting to participate submitted a brief online form, all of whom completed study visits. We targeted a sample size of 20–25—generally thought to be sufficient to achieve saturation of themes in qualitative research . Recruitment ended when the qualitative coding team confirmed that saturation was met (i.e. no new themes were arising from the qualitative data). We utilized the Consolidated Criteria for Reporting Qualitative Research (COREQ) reporting guidelines (see Additional File 1).
Our multiple methods approach utilized separate quantitative and qualitative methods to answer distinct subdomains of the larger question of how CDS might best improve HIV prevention service delivery . Participants completed a single visit consisting of computer-assisted survey instruments assessing attitudes toward CDS and considerations for designing effective CDS. These measures were followed by individual semi-structured interviews eliciting HIV prevention-related steps in the primary care workflow, exploring barriers and facilitators to CDS implementation, and discussing how CDS might address inequities in HIV screening for cisgender females in particular, and across diverse populations of youth . Interviews were conducted by a female research assistant holding a BA degree (J.P.) who received qualitative interview training from two researchers holding MD, MSHP (S.W.), and MPH (D.P.) degrees. Participants had no prior relationship with the interviewer. Audio-recorded interviews were conducted in providers’ clinical offices and lasted 25–45 min. No additional written fieldnotes were recorded. Participants were compensated $25.
Surveys assessed provider age, race, ethnicity, sex, gender, clinic, educational degree, formal adolescent medicine training, and years in practice.
Participants were asked how many adolescents they saw on average monthly. Frequency of discussing sexual activity with their patients was measured on a 5-point Likert scale. Responses were categorized as infrequently/never, about half the time, and most/all of the time. Providers were asked if they had heard of PrEP prior to the study and how many times they prescribed or referred to another clinic for PrEP.
Acceptability, appropriateness, and feasibility of CDS
The perceived acceptability, appropriateness, and feasibility (key measures in the Proctor implementation outcomes framework ) of implementing EHR-based CDS to improve HIV testing and PrEP delivery were measured using the Acceptability of Intervention Measure (AIM), Intervention Appropriateness Measure (IAM), and Feasibility of Intervention Measure (FIM) , validated Likert scale measures with a maximum score of 5 (“Completely agree”).
Design considerations for CDS
Participants ranked a set of seven proposed CDS tools in terms of appeal from 1 (highest) to 7 (lowest). These tools were based on existing primary care system EHR tools for asthma and immunizations that had demonstrated measurable improvements in patient outcomes [35,36,37,38,39]. The proposed tools included an (1) electronic self-screening questionnaire capturing sexual activity information in the EHR, (2) automated referrals to prevention counselors triggered by STI results, (3) HIV testing alerts triggered by STI results, (4) HIV testing alerts for all adolescents, (5) default HIV test orders, (6) a bundled tool including alerts and defaulted STI and HIV test orders and (7) PrEP counseling alerts triggered by STI results.
We used summary statistics to analyze survey findings, using Stata 15 (StataCorp, College Station, TX). Median and interquartile ranges (IQRs) were used for items with a non-normal distribution.
The first part of the interviews used a hypothetical clinical case vignette of an adolescent with a new STI to elicit the HIV prevention workflow in primary care and explore context-specific barriers and facilitators to HIV testing and PrEP initiation. Each vignette was pilot tested with five pediatricians prior to use. Vignettes were chosen at random for each participant (Supplementary Fig. 1). The second part of the interview, informed a priori by the Consolidated Framework for Implementation Research (CFIR), asked questions regarding multi-dimensional barriers and facilitators to CDS as an intervention . We focused on four CFIR constructs: (I) Intervention Characteristics (e.g. cost, adaptability, trialability), (II) Inner Setting (clinic context), (III) Outer Setting (external/environmental considerations and patient needs), and (IV) Characteristics of Individuals (primary care providers). We omitted the Process construct given the study’s pre-implementation focus.
Interviews were transcribed by an independent agency and coded using two approaches to understand (1) the discrete steps of the primary care workflow where CDS might influence provision of HIV testing or PrEP services, and (2) multi-level barriers to CDS implementation. Transcripts were coded by three members of the research team (D.P., P.M., J.P.). We first performed a work domain analysis, a method which evaluates the purposes, values, functions, and resources of a given work system [41,42,43]. We used responses to the vignettes to delineate the workflow and decision-making steps faced in primary care encounters, aiming to understand how each workflow step could be a locus for future CDS intervention. We added each workflow step to our codebook, and text relating to each step was thematically analyzed to identify barriers and facilitators to CDS delivery. Secondly, we used a deductive approach to map barriers and facilitators to using CDS to CFIR domains. Within the CFIR domains, interview text was coded to identify salient themes. To achieve inter-rater reliability for both coding processes, transcripts were independently coded in Nvivo 12 Plus (QSR International Pty Ltd. Version 12, 2018) by two raters until the kappa statistic for each coding team reached 0.9. Discrepancies were resolved through consensus.
We used quantitative findings from the ranking exercises, key findings from the work domain analysis, and themes which emerged from our CFIR coding to develop an Implementation Research Logic Model (IRLM). The IRLM approach aims to describe the determinants, strategies, mechanism, and outcome processes that may improve the adoption of interventions in health care . We utilized three distinct implementation science frameworks to comprehensively address determinants, strategies, and outcomes . Implementation determinants identified in our interviews were organized using the CFIR, as specified a priori in our study design. Post hoc, we mapped implementation strategies for CDS that could enhance the implementation and sustainability of CDS, identified from the interview and ranking exercises, onto the Expert Recommendations for Implementing Change (ERIC) taxonomy . Lastly, we mapped implementation outcomes for future measurement onto the Proctor outcomes framework, including those specified a priori in our survey instruments and additional outcomes highlighted in participant-derived data .
Demographic characteristics of participants (n = 26) are displayed in Table 1. Most participants were white cisgender female physicians. Almost all had heard of PrEP and over one-third self-reported prescribing PrEP. Providers rated the potential use of EHR-based CDS tools to improve HIV testing and PrEP delivery as acceptable (median score 5, IQR [4-5]) and appropriate (5, IQR [4-5]). However, feasibility ratings were slightly lower (4, IQR [3.75–4.75]), with 26% disagreeing that implementation would be “easy to do.” Of the seven proposed CDS tools (Table 2), the highest-ranking was the patient electronic self-screening tool, followed by alerts to providers for HIV screening for patients with STIs. The lowest overall ranking tool was default HIV testing orders. Rankings of CDS tools by ranged from 1 (highest) to 7 (lowest) for each of the tools.
We identified 10 unique decision-making steps of the pediatric well visit in the work domain analysis (Fig. 1). Key themes describing contextual barriers and facilitators of implementing HIV prevention CDS in pediatric visits are described below with exemplar quotes displayed in Table 3.
Theme 1: Optimizing CDS integration within the primary care workflow (CFIR domain: Intervention)
Providers stressed the importance of placing CDS within the “right step” of the visit workflow, with particular consideration given to efficiency and confidentiality. For example, one provider noted that an EHR alert for PrEP counseling should not be triggered when parents are in the room due to risk of breaching confidentiality. Another consideration was a desire for CDS to be deployed while a patient is still physically in the clinic, to ensure CDS could be acted upon immediately, as opposed to during EHR chart documentation which is often asynchronous with the visit. Participants also wanted any new CDS to be piloted prior to implementation, recalling negative experiences with previous primary care EHR-based CDS that had not been piloted and were unsuitable for their workflow. Lastly, providers identified the need to consider the presence of other CDS in the workflow; too many unrelated CDS systems could contribute to a sense of burnout. While some providers highlighted successful changes in their own practice stemming from existing immunization and asthma-related CDS, providers also noted feeling overwhelmed by the sheer volume of EHR alerts and nudges. They raised concerns about additional CDS increasing the potential for alert fatigue—desensitization to EHR alerts due to an overwhelming number of alerts.
Theme 2: Designing for standardization, with room for adaptable CDS design (Intervention)
Providers raised the need for HIV screening CDS to be standardized for all adolescents, irrespective of HIV risk factors. Universal application of CDS could eliminate risk-based decision-making calculations using sexual history and lab data, thus reducing cognitive load. Universal CDS was also noted to have the potential to minimize provider implicit bias. Bias was most frequently discussed in the context of providers reporting being less likely to order HIV screening or consider PrEP for cisgender heterosexual female patients, as they were perceived as lower risk compared to sexual and gender minority youth. Finally, providers felt that standardization through universal alerts would increase fidelity to clinical guidelines and reduce stigma. As a complementary approach, in addition to universal CDS, other providers desired CDS elements that could deliver a broader scope of recommended resources and clinical guidance based on individual HIV risk. These providers desired algorithmic approaches using EHR data, such as STI results, to further customize decision support. In this approach, the format or type of CDS (for example, a simple pop-up alert to test for HIV for all patients versus links to a templated PrEP order set with CDC guidelines for those with recent STIs) could use objective data to provide more services to patients with higher vulnerability to HIV.
Theme 3: Recognizing the need for confidential care (Outer Setting)
Similar to the ubiquitous barrier of time pressure, the need to protect confidential sexual health information was a consideration at each workflow step. Participants noted that CDS alone would be unlikely to yield gains in HIV prevention in the absence of changes to funding and insurance billing practices to protect minor confidentiality. Specifically, providers discussed the utility of increasing access to federal Title X funding to allow expansion of confidential sexual health services. Providers had concerns about threats to confidentiality for privately insured patients due to explanations of benefits for HIV testing or PrEP services being sent to home addresses, risking disclosure of sexual activity and/or sexual orientation to parents. Some providers felt confidentiality concerns were more salient for cisgender female patients given norms by which female adolescents were perceived to experience more stigma around sexual activity than male adolescents.
Theme 4: Improving accurate HIV risk perception (Outer Setting, Individuals)
Many providers noted that adolescents, particularly those with STIs, did not perceive themselves as at-risk for HIV or eligible for PrEP. This mismatched risk perception was seen as a barrier to HIV testing and PrEP uptake that would not be addressed by CDS, suggesting that additional patient-facing interventions were needed to increase HIV testing and PrEP uptake. In addition to adolescent patients’ self-assessment of HIV risk, providers’ perceptions of patient risk also influenced their clinical decision-making. Some providers expressed that CDS focused on universal HIV testing could be a waste of resources, perceiving that cisgender female adolescents are at very low risk of acquiring HIV.
Theme 5: Recognizing limitations of time and staff as available resources (Inner Setting)
Providers emphasized that CDS development should consider clinic time as a critical resource, given the extensive array of clinical responsibilities at well visits. Providers also expressed the need for additional resources to maximize CDS effectiveness, such as rapid HIV tests, implicit bias training for providers, and patient education materials. Providers noted that time challenges were often greatest for cisgender female patients. Given the need to also discuss menstruation and contraception during sexual health conversations, competing priorities diminished time for addressing HIV testing and PrEP counseling. Participants also suggested that CDS alone would not improve HIV prevention without changes to staff roles and workflow. Providers stressed the need for involvement of staff other than pediatricians to optimize HIV testing and prevention counseling. Two examples—medical assistant-led HIV rapid testing and nurse-led HIV prevention counseling—involved shifting responsibilities of pre-test counseling and result delivery to allied members of the healthcare team.
Theme 6: Prioritizing HIV relative to other primary care needs (Inner Setting)
Many providers felt that while HIV and PrEP were important topics, they fell below more prevalent and immediate health concerns, such as depression, school performance, and obesity. Providers also reported concerns about having insufficient time to address HIV given priority placed on mandated health system performance measures, including depression screening. Perceptions of the relative priority of HIV also influenced providers’ attitudes toward implementing HIV prevention CDS. Some providers had concerns about feeling “forced” to discuss PrEP without having sufficient knowledge or time to do so. However, others noted that their clinic would and should be prepared to talk about HIV prevention and PrEP as part of their purview as primary care providers.
Theme 7: Increasing provider knowledge about HIV testing and PrEP (Individuals)
Providers noted that their knowledge (or lack thereof) regarding HIV testing and PrEP would influence how effectively they could utilize HIV prevention CDS. For example, for providers with no prior knowledge of PrEP, CDS would need to efficiently provide education, links to HIV prevention guidelines, or be accompanied by educational efforts to increase competency across clinical staff.
Integration of findings
In Fig. 2, we synthesize our key findings and provide an Implementation Research Logic Model for CDS implementation for HIV prevention-oriented pediatric primary care. Within the model, we propose seven essential strategies for CDS implementation framed within the ERIC taxonomy that are based on participant survey responses and the qualitative themes described above: (1) Conducting cyclical usability testing to optimize CDS within the workflow, (2) adapting to context by using pre-visit confidential patient-collected sexual health information to trigger CDS early in the visit, (3) providing strong guidance reinforcing equity by introducing defaulted HIV testing orders to improve universal testing, (4) using EHR alerts to remind providers of need for HIV prevention within busy clinical care encounters, (5) embedding clinical practice guidelines within CDS to increase provider knowledge, (6) expanding clinical teams to shift HIV prevention responsibilities away from pediatricians and advanced practice providers and (7) educating patients to increase awareness of their need for HIV testing.
In this pre-implementation study, we performed a deep contextual inquiry and developed an Implementation Research Logic Model to improve the reach and equity of HIV testing and PrEP delivery at adolescent preventative care visits. With respect to determinants of CDS implementation, in our logic model (light gray boxes, Fig. 2) limited time to provide HIV prevention care at primary care visits was one of the most salient themes in both the work domain and CFIR-based analyses. The American Academy of Pediatrics (AAP) Bright Futures framework recommends five mandated health screenings, seven risk-based screenings, and nineteen potential topics for anticipatory guidance at the 15–17-year-old well visit . Exploring how interventions are deployed within existing workflows is consistent with best practices for improving CDS usability as delineated by the U.S. Department of Health and Human Services Agency for Healthcare Research and Quality and previous analyses [28, 48,49,50]. Our findings demonstrate the need for future CDS to address competing priorities and providers’ high mental workload within primary care visits. By using work domain analysis, we identified key implementation considerations, such as the critical need to maintain patient confidentiality, within the unique workflow of an adolescent well visit.
The time pressures described by participants also reinforced the potential for implicit bias to impact perceptions of patients’ need or eligibility for HIV testing and PrEP services. Participants discussed their own and colleagues’ biases wherein cisgender heterosexual females were perceived of being at very low risk for HIV infection, and thus often not screened for HIV or considered for PrEP. These findings suggest that providers may narrow in on a patient’s sexual orientation, sex, or gender, at the expense of objective biomarkers that indicate increased HIV risk, such as STIs or evidence-based recommendations for universal testing irrespective of HIV risk. While cisgender adolescent girls account for only 12% of U.S. youth HIV diagnoses, these data need to be contextualized in the very low HIV screening rates in this population. Only 9% of high school students have ever received an HIV test, and nearly half of youth with HIV have not been tested and are therefore unaware of their diagnosis . Additionally, PrEP awareness and adoption remain low among adolescent MSM and transgender youth, despite recognition of the importance of PrEP for these key populations [52, 53].
Based on our interview data, we added equity as an additional Implementation Outcome in our logic model (Fig. 2, striped box). Future CDS interventions should carefully measure not only gains in HIV testing and PrEP delivery, but also equitable delivery across populations of adolescents.
With respect to implementation strategies (Fig. 2, dark gray box), most providers noted the importance of CDS supporting universal screening. In the context of AAP and CDC recommendations for universal HIV screening, and recent CDC guidance that all sexually active individuals receive information about PrEP , our results support designing CDS which provides a universal prompt for HIV screening for all adolescents to maximize reach and increase equity . However, our qualitative and quantitative findings also demonstrate high appeal for the implementation strategy of adapting the CDS to a patient’s unique context. In this strategy, pre-visit patient self-reported data on sexual activity, sexual orientation, and gender identity, combined with STI lab test data, could trigger a stronger prompt to not only test for HIV, but to also counsel on PrEP or provide additional prevention services. Prior studies have shown success with electronic collection of pre-visit data, including patient sexual orientation and gender identity information [54, 55]. Having sexual activity data available at the start of the visit decreases reliance on provider self-efficacy to discuss sexual health and avoids biases by circumventing provider judgments on “who to screen” for sexual activity. Including sexual orientation and gender identity data can also allow for culturally humble tailoring of sexual health information for sexual and gender minority adolescents.
While CDS was the primary focus of our research, clinicians noted that attending to structural issues within both the inner and outer settings, including availability of rapid testing, staffing structures, and assuring confidentiality of care within the clinic and throughout billing processes, are essential for improving HIV prevention care delivery in pediatric primary care [56,57,58,59]. Notably, providers identified task-shifting among the healthcare team as one structural area to explore. Restructuring workflows, including shifting HIV testing and PrEP counseling to nurses or health educators, has been demonstrated to be a promising strategy for improving HIV prevention service delivery [56, 57, 60]. From a CDS perspective, task-shifting also provides opportunities to have multiple target users for CDS including nurses, medical assistants, and front-desk staff.
Our study has several limitations. Although our sample was similar in characteristics to the network primary care provider population, which is composed of 83% female and 84% physician providers, most participants were white female physicians, which may limit generalizability. We do not have data on providers who opted not to participate in the study, whose perspectives may differ from participants’. Our data were derived from a large urban health system in a high HIV prevalence region and participants may therefore have higher levels of PrEP awareness than typical. However, participants ranged from those who felt confident prescribing PrEP to those who had never heard of PrEP. While participants frequently noted high mental workload as a barrier to HIV testing and PrEP delivery, our study did not include formal measures of mental workload, many of which require complex physiologic measurement . There is a need for both development of pragmatic measurement strategies for mental workload, and inclusion of these measures in future studies. Participants did not receive interview transcripts or provide feedback on study findings. Future studies will benefit from triangulation of findings with provider teams. We provided example CDS tools and content to participants in the ranking exercise completed prior to the interview, which may have affected providers’ discussions regarding CDS tools, barriers, and facilitators. However, these examples were based on existing health system CDS with which participants were already familiar. Lastly, given our small sample size and high level of acceptability of a proposed CDS system, we were unable to compare themes between providers by attitudes toward using CDS to improve HIV prevention delivery. However, we were able to achieve saturation of themes across the interviews.
Our study provides a detailed understanding of the factors that providers view as most influential in the use of CDS to improve equitable delivery of HIV testing and PrEP services in adolescent primary care. For future implementation efforts, our findings suggest that prioritizing CDS system development early in the visit, focused on pre-visit self-reported risk screening to drive alerts, may have the greatest downstream yields in increasing efficiency and decreasing cognitive burden. Furthermore, future CDS interventions should address the themes that were most prominent across all visit steps: time and staffing constraints, confidentiality of sexual health information, and provider and patient knowledge and self-efficacy. By contextually focusing CDS efforts on the specific needs of the pediatric primary care environment, health systems can maximize effectiveness gains in improving equitable delivery of HIV prevention services.
Availability of data and materials
Data may be made available through formal data sharing agreement with the authors’ institution.
American Academy of Pediatrics
Acceptability of Intervention Measure
Centers for Disease Control and Prevention
Clinical decision support
Consolidated Framework for Implementation Research
Electronic health record
Expert Recommendations for Implementing Change
Feasibility of Intervention Measure
Implementation Research Logic Model
Intervention Appropriateness Measure
Men who have sex with men
Sexually transmitted infection
Magnuson DH. Adolescent use of Truvada (FTC/TDF) for HIV pre-exposure prophylaxis (PrEP) in the United States (2012–2017). AIDS 2018: 22nd International AIDS Conference; July 23–27, 2018, 2018; Amsterdam, Netherlands.
Siegler AJ, Mouhanna F, Giler RM, Weiss K, Pembleton E, Guest J, et al. The prevalence of pre-exposure prophylaxis use and the pre-exposure prophylaxis-to-need ratio in the fourth quarter of 2017. United States Ann Epidemiol. 2018;28(12):841–9.
Goyal MK, Witt R, Hayes KL, Zaoutis TE, Gerber JS. Clinician adherence to recommendations for screening of adolescents for sexual activity and sexually transmitted infection/human immunodeficiency virus. J Pediatr. 2014;165(2):343–7.
Underwood JM, Brener N, Thornton J, Harris WA, Bryan LN, Shanklin SL, et al. Youth Risk Behavior Surveillance System - United States, 2019. MMWR Suppl. 2020;69(1):11–8.
Watson DL, Shaw PA, Petsis DT, Pickel J, Bauermeister JA, Frank I, et al. A retrospective study of HIV pre-exposure prophylaxis counselling among non-Hispanic Black youth diagnosed with bacterial sexually transmitted infections in the United States, 2014–2019. J Int AIDS Soc. 2022;25(2): e25867.
Petsis D, Min J, Huang YV, Akers AY, Wood S. HIV Testing Among Adolescents With Acute Sexually Transmitted Infections. Pediatrics. 2020;145(4):1–8.
Centers for Disease Control and Prevention. Monitoring selected national HIV prevention and care objectives by using HIV surveillance data—United States and 6 dependent areas, 2019. HIV Surveill Supplement Rep. 2021;26(2):9–53.
Centers for Disease Control and Prevention: US Public Health Service: Preexposure prophylaxis for the prevention of HIV infection in the United States—2021 Update: a clinical practice guideline. https://www.cdc.gov/hiv/pdf/risk/prep/cdc-hiv-prep-guidelines-2021.pdf. Published December 2021.
Karsh B-T. Clinical Practice Improvement and Redesign: How Change in Workflow Can Be Supported by Clinical Decision Support. 2009.
Johnson TJ, Hickey RW, Switzer GE, Miller E, Winger DG, Nguyen M, et al. The Impact of Cognitive Stressors in the Emergency Department on Physician Implicit Racial Bias. Acad Emerg Med. 2016;23(3):297–305.
Galvin SR, Cohen MS. The role of sexually transmitted diseases in HIV transmission. Nat Rev Microbiol. 2004;2(1):33–42.
Stern M. Perspectives of LGBTQ Youth and Pediatricians in the Primary Care Setting: A Systematic Review. J Prim Care Community Health. 2021;12:21501327211044356.
Pickel J, Singapur A, Min J, Petsis D, Campbell K, Wood S. Variability in Sexual History Documentation in a Primary Care Electronic Health Record System. J Adolesc Health. 2022;70(3):435–41.
Burgess DJ. Are providers more likely to contribute to healthcare disparities under high levels of cognitive load? How features of the healthcare setting may lead to biases in medical decision making. Med Decis Making. 2010;30(2):246–57.
Byrne A, Tanesini A. Instilling new habits: addressing implicit bias in healthcare professionals. Adv Health Sci Educ Theory Pract. 2015;20(5):1255–62.
Bonacci RA, Smith DK, Ojikutu BO. Toward Greater Pre-exposure Prophylaxis Equity: Increasing Provision and Uptake for Black and Hispanic/Latino Individuals in the US. Am J Prev Med. 2021;61(5 Suppl 1):S60-s72.
Wood S, Min J, Tam V, Pickel J, Petsis D, Campbell K. Inequities in Chlamydia trachomatis Screening Between Black and White Adolescents in a Large Pediatric Primary Care Network, 2015–2019. Am J Public Health. 2022;112(1):135–43.
Baugher AR, Trujillo L, Kanny D, Freeman JQ, Hickey T, Sionean C, et al. Racial, Ethnic, and Gender Disparities in Awareness of Preexposure Prophylaxis Among HIV-Negative Heterosexually Active Adults at Increased Risk for HIV Infection - 23 Urban Areas, United States, 2019. MMWR Morb Mortal Wkly Rep. 2021;70(47):1635–9.
Kanny D, Jeffries WLt, Chapin-Bardales J, Denning P, Cha S, Finlayson T, et al. Racial/Ethnic Disparities in HIV Preexposure Prophylaxis Among Men Who Have Sex with Men - 23 Urban Areas, 2017. MMWR Morb Mortal Wkly Rep. 2019;68(37):801–6.
Nunn AS, Brinkley-Rubinstein L, Oldenburg CE, Mayer KH, Mimiaga M, Patel R, et al. Defining the HIV pre-exposure prophylaxis care continuum. AIDS. 2017;31(5):731–4.
Hull SJ, Tessema H, Thuku J, Scott RK. Providers PrEP: Identifying Primary Health care Providers’ Biases as Barriers to Provision of Equitable PrEP Services. J Acquir Immune Defic Syndr. 2021;88(2):165–72.
Workowski KA, Bachmann LH, Chan PA, Johnston CM, Muzny CA, Park I, et al. Sexually Transmitted Infections Treatment Guidelines, 2021. MMWR Recomm Rep. 2021;70(4):1–187.
Kreisel KM, Spicknall IH, Gargano JW, Lewis FMT, Lewis RM, Markowitz LE, et al. Sexually Transmitted Infections Among US Women and Men: Prevalence and Incidence Estimates, 2018. Sex Transm Dis. 2021;48(4):208–14.
Raifman JR, Schwartz SR, Sosnowy CD, Montgomery MC, Almonte A, Bazzi AR, et al. Brief Report: Pre-exposure Prophylaxis Awareness and Use Among Cisgender Women at a Sexually Transmitted Disease Clinic. J Acquir Immune Defic Syndr. 2019;80(1):36–9.
Centers for Disease Control and Prevention. Core indicators for monitoring the Ending the HIV Epidemic initiative (preliminary data): National HIV Surveillance System data reported through June 2021; and preexposure prophylaxis (PrEP) data reported through March 2021. HIV Surveillance Data Tables 2021;2(No. 4). http://www.cdc.gov/hiv/library/reports/hiv-surveillance.html. Published October 2021.
Patel MS, Kurtzman GW, Kannan S, Small DS, Morris A, Honeywell S Jr, et al. Effect of an Automated Patient Dashboard Using Active Choice and Peer Comparison Performance Feedback to Physicians on Statin Prescribing: The PRESCRIBE Cluster Randomized Clinical Trial. JAMA Netw Open. 2018;1(3):e180818.
Teich JM, Osheroff JA, Pifer EA, Sittig DF, Jenders RA. Clinical decision support in electronic prescribing: recommendations and an action plan: report of the joint clinical decision support workgroup. J Am Med Inform Assoc. 2005;12(4):365–76.
Berner ES. Clinical Decision Support Systems: State of the Art. 2009.
Brunner J, Chuang E, Goldzweig C, Cain CL, Sugar C, Yano EM. User-centered design to improve clinical decision support in primary care. Int J Med Inform. 2017;104:56–64.
Martha D, Sousa VD, Mendes IA. An overview of research designs relevant to nursing: Part 3: mixed and multiple methods. Rev Lat Am Enfermagem. 2007;15(5):1046–9.
Fiks AG, Grundmeier RW, Margolis B, Bell LM, Steffes J, Massey J, et al. Comparative effectiveness research using the electronic medical record: an emerging area of investigation in pediatric primary care. J Pediatr. 2012;160(5):719–24.
Mason M. Sample Size and Saturation in PhD Studies Using Qualitative Interviews. Forum Qual Sozialforschung Forum: Qual Soc Res. 2010;11(3):Article 8.
Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Health. 2011;38(2):65–76.
Weiner BJ, Lewis CC, Stanick C, Powell BJ, Dorsey CN, Clary AS, et al. Psychometric assessment of three newly developed implementation outcome measures. Implement Sci. 2017;12(1):108.
Fiks AG, Grundmeier RW, Mayne S, Song L, Feemster K, Karavite D, et al. Effectiveness of decision support for families, clinicians, or both on HPV vaccine receipt. Pediatrics. 2013;131(6):1114–24.
Fiks AG, Hunter KF, Localio AR, Grundmeier RW, Bryant-Stephens T, Luberti AA, et al. Impact of electronic health record-based alerts on influenza vaccination for children with asthma. Pediatrics. 2009;124(1):159–69.
Fiks AG, Grundmeier RW, Biggs LM, Localio AR, Alessandrini EA. Impact of clinical alerts within an electronic health record on routine childhood immunization in an urban pediatric population. Pediatrics. 2007;120(4):707–14.
Bell LM, Grundmeier R, Localio R, Zorc J, Fiks AG, Zhang X, et al. Electronic health record-based decision support to improve asthma care: a cluster-randomized trial. Pediatrics. 2010;125(4):e770–7.
Fiks AG, Mayne SL, Karavite DJ, Suh A, O’Hara R, Localio AR, et al. Parent-reported outcomes of a shared decision-making portal in asthma: a practice-based RCT. Pediatrics. 2015;135(4):e965–73.
Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4:50.
Militello LG, Hutton RJ. Applied cognitive task analysis (ACTA): a practitioner’s toolkit for understanding cognitive task demands. Ergonomics. 1998;41(11):1618–41.
Naikar N, Hopcroft R, Moylan AM. editors. Work Domain Analysis: Theoretical Concepts and Methodology 2005. Victoria, Australia: Air Operations Division, DSTO Defence Science and Technology Organisation; 2005.
Rasmussen J. Cognitive systems engineering. In: Pejtersen AM, Goodstein LP, editors. New York: Wiley; 1994.
Smith JD, Li DH, Rafferty MR. The Implementation Research Logic Model: a method for planning, executing, reporting, and synthesizing implementation projects. Implement Sci. 2020;15(1):84.
Moullin JC, Dickson KS, Stadnick NA, Albers B, Nilsen P, Broder-Fingert S, et al. Ten recommendations for using implementation frameworks in research and practice. Implement Sci Commun. 2020;1:42.
Waltz TJ, Powell BJ, Chinman MJ, Smith JL, Matthieu MM, Proctor EK, et al. Expert recommendations for implementing change (ERIC): protocol for a mixed methods study. Implement Sci. 2014;9(1):39.
Hagan JF, Shaw JS, Duncan PM. Adolescent Visits 11–21 Years. 2017 February 15, 2017. In: Bright Futures Guidelines for Health Supervision of Infants, Children and Adolescents, 4th Edition. Online: American Academy of Pediatrics [731–822].
Saleem JJ, Patterson ES, Militello L, Render ML, Orshansky G, Asch SM. Exploring barriers and facilitators to the use of computerized clinical reminders. J Am Med Inform Assoc. 2005;12(4):438–47.
Bates DW, Kuperman GJ, Wang S, Gandhi T, Kittler A, Volk L, et al. Ten commandments for effective clinical decision support: making the practice of evidence-based medicine a reality. J Am Med Inform Assoc. 2003;10(6):523–30.
McGinn TG, McCullagh L, Kannry J, Knaus M, Sofianou A, Wisnivesky JP, et al. Efficacy of an evidence-based clinical decision support in primary care practices: a randomized clinical trial. JAMA Intern Med. 2013;173(17):1584–91.
Centers for Disease Control and Prevention (CDC). HIV Information and Youth. Available at https://www.cdc.gov/healthyyouth/youth_hiv/hiv-information-and-youth.htm. Accessed on 18 July 2022.
Jaiswal J, LoSchiavo C, Meanley S, Hascher K, Cox AB, Dunlap KB, et al. Correlates of PrEP Uptake Among Young Sexual Minority Men and Transgender Women in New York City: The Need to Reframe “Risk” Messaging and Normalize Preventative Health. AIDS Behav. 2021;25(10):3057–73.
Fisher CB, Fried AL, Desmond M, Macapagal K, Mustanski B. Facilitators and Barriers to Participation in PrEP HIV Prevention Trials Involving Transgender Male and Female Adolescents and Emerging Adults. AIDS Educ Prev. 2017;29(3):205–17.
Grasso C, McDowell MJ, Goldhammer H, Keuroghlian AS. Planning and implementing sexual orientation and gender identity data collection in electronic health records. J Am Med Inform Assoc. 2019;26(1):66–70.
Cahill S, Singal R, Grasso C, King D, Mayer K, Baker K, et al. Do Ask, Do Tell: High Levels of Acceptability by Patients of Routine Collection of Sexual Orientation and Gender Identity Data in Four Diverse American Community Health Centers. PLoS ONE. 2014;9(9):e107104.
Pleuhs B, Quinn KG, Walsh JL, Petroll AE, John SA. Health Care Provider Barriers to HIV Pre-Exposure Prophylaxis in the United States: A Systematic Review. AIDS Patient Care STDS. 2020;34(3):111–23.
Siegler AJ, Steehler K, Sales JM, Krakower DS. A Review of HIV Pre-exposure Prophylaxis Streamlining Strategies. Curr HIV/AIDS Rep. 2020;17(6):643–53.
Mullins TL, Zimet G, Lally M, Kahn JA. Adolescent Human Immunodeficiency Virus Care Providers’ Attitudes Toward the Use of Oral Pre-Exposure Prophylaxis in Youth. AIDS Patient Care STDS. 2016;30(7):339–48.
Valente PK, Bauermeister JA, Lin WY, Operario D, Rusley J, Hightow-Weidman L, et al. Next Generation Pre-Exposure Prophylaxis for Young Men who have Sex with Men: Lessons from System and Provider-level barriers to oral PrEP. AIDS Behav. 2022;26(10):3422–35.
O’Byrne P, Vandyk A, Orser L, Haines M. Nurse-led PrEP-RN clinic: a prospective cohort study exploring task-Shifting HIV prevention to public health nurses. BMJ Open. 2021;11(1):e040817.
Tao D, Tan H, Wang H, Zhang X, Qu X, Zhang T. A Systematic Review of Physiological Measures of Mental Workload. Int J Environ Res Public Health. 2019;16(15):2716.
We want to thank the network of primary care providers for their contribution to this project and clinical research facilitated through the Pediatric Research Consortium (PeRC) at The Children’s Hospital of Philadelphia.
Penn Center for AIDS Research Implementation Science in Philadelphia for Ending the HIV Epidemic Regionally (ISPHERE) P30 AI045008 (Wood, Gross, Beidas); NIMH Career Development Award K23MH119976 (Wood); University of Pennsylvania Building; Interdisciplinary Research Careers in Women’s Health Pilot Award K12-HD085848-01 (Wood). The above funding bodies did not contribute directly to the design of the study and collection, analysis, and interpretation of data or writing the manuscript.
Ethics approval and consent to participate
The Institutional Review Board of Children’s Hospital of Philadelphia approved study procedures and informed consent was obtained from all participants prior to study procedures (IRB 19–016650).
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Additional file 1.
Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups.
Additional file 2: Supplementary Figure 1.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Pickel, J., Fiks, A.G., Karavite, D. et al. Provider perspectives on clinical decision support to improve HIV prevention in pediatric primary care: a multiple methods study. Implement Sci Commun 4, 18 (2023). https://doi.org/10.1186/s43058-023-00394-7
- Primary care
- Implementation science
- Pre-exposure prophylaxis
- Implicit bias