The effect of caregiver key opinion leaders on increasing caregiver demand for evidence-based practices to treat youth anxiety: protocol for a randomized control trial
Implementation Science Communications volume 2, Article number: 107 (2021)
Research has identified cognitive behavioral therapy with exposures (CBT) as an effective treatment for youth anxiety. Despite implementation efforts, few anxious youth receive CBT. Direct-to-consumer marketing offers a different approach to address the unmet need for youth receiving effective treatments. Involving a local caregiver key opinion leader in direct-to-consumer initiatives may be an effective strategy to increase caregiver demand for CBT. Research indicates that key opinion leaders improve health promotion campaigns, but key opinion leaders have not been studied in the context of increasing caregiver demand for evidence-based treatments.
Project CHAT (Caregivers Hearing about Anxiety Treatments) will test the role of key opinion leader participation in conducting outreach presentations to increase caregiver desire to seek CBT for their youth’s anxiety. Caregiver attendees (N = 180) will be cluster randomized by school to receive one of two different approaches for presentations on CBT for youth anxiety. Both approaches will involve community outreach presentations providing information on recognizing youth anxiety, strategies caregivers can use to decrease youth anxiety, and how to seek CBT for youth anxiety. The researcher-only condition will be co-facilitated by two researchers. In the key opinion leader condition, a caregiver key opinion leader from each local community will be involved in tailoring the content of the presentation to the context of the community, co-facilitating the presentation with a researcher, and endorsing strategies in the presentation that they have found to be helpful. In line with the theory of planned behavior, caregiver attendees will complete measures assessing their knowledge of, attitudes towards, perceived subjective norms about, and intention to seek CBT pre- and post-presentation; they will indicate whether they sought CBT for their youth at 3-month follow-up. Results will be analyzed using a mixed method approach to assess the effectiveness of a key opinion leader to increase caregiver demand for CBT.
This study will be the first to examine the potential of key opinion leaders to increase caregiver demand for CBT. If proven effective, the use of key opinion leaders could serve as a scalable dissemination strategy to increase the reach of evidence-based treatments.
This trial was registered on clinicaltrials.gov (NCT04929262) on June 18, 2021. At the time of trial registration, pre/post-presentation data had been collected from 17 participants; thus, it was retrospectively registered.
Anxiety disorders are highly prevalent among youth, affecting 10–20% of youth [1, 2]. Without intervention, these disorders rarely remit and have adverse sequelae, including educational underachievement, poor social relationships, suicidality, and increased substance use [3,4,5,6,7]. Anxiety disorders create a public health burden from disability, productivity loss, and health care costs [8,9,10]. Research has identified cognitive behavioral therapy (CBT) as the most effective psychological treatment for youth anxiety [11,12,13]; exposure is one of the most effective strategies used in CBT for anxiety . Despite research identifying treatments that work, CBT is underutilized in community settings . Only one third of youth with mental health disorders are estimated to receive any treatment , and far fewer receive CBT . The majority of dissemination and implementation efforts to increase evidence-based practices (EBPs) use have focused on a “top-down” approach that targets service providers, primarily by increasing the number of practitioners trained in EBPs . Within dissemination and implementation science, dissemination strategies have been understudied relative to implementation strategies [17,18,19].
Direct-to-consumer (DTC) marketing offers a promising approach. DTC dissemination approaches are “bottom-up,” targeting the consumer to improve their understanding of mental health problems, shape their treatment-seeking behavior, and ultimately, increase public demand for CBT [20, 21]. For youth, caregivers are considered the consumer, as they determine and pay for the youth’s services [20, 22, 23]. Although DTC approaches have had success in the pharmaceutical industry , this approach is most appropriate for treatments that are safe, supported by research, and underutilized, such as CBT with exposure .
Patient barriers to youth receiving EBPs
DTC initiatives are important given patient barriers to youth receiving treatment. Patient barriers include lack of recognition that treatment is needed, lack of knowledge on how to seek effective treatment, and associated stigma [25,26,27,28,29]. Research suggests that attitudinal barriers (e.g., not perceiving a need for therapy) have a greater impact on treatment utilization than structural barriers (e.g., cost) . Mental health literacy involves the recognition of mental health disorders and knowledge about when and how to seek treatment for them . Caregivers are more likely to seek help if they recognize that their youth has a mental health problem [32, 33]. The belief that therapy will be helpful is associated with the use of mental health services [27, 32, 34], but many individuals do not believe that therapy will be helpful . Of those who want therapy, most do not know how to seek effective treatment [26, 35,36,37]. Many people hold the belief that treatments are equally effective [24, 31]. Increasing knowledge and awareness of EBPs is key for caregivers to make informed decisions [38, 39].
Increasing knowledge is unlikely to change service-seeking behavior if caregiver stigma about seeking mental health services is not addressed [25, 27, 40]. Caregivers with an anxious child may face family stigma, which arises by association with a stigmatized person [41, 42]. Family stigma can involve public stigma (e.g., stereotypes of blame, shame ), and internalized/self-stigma (e.g., self-blame, “bad-caregiver beliefs” [43, 44]). Stigma affects treatment seeking in part because a person may wish to avoid receiving a label of having a mental health issue [45,46,47]. Some research suggests that increased perceived treatment need and knowledge of how to access treatment at least partially account for the relationship between stigma and treatment seeking [46, 48,49,50].
Current direct-to-consumer efforts
DTC programs aim to increase caregivers’ mental health literacy and decrease stigma. Mental health literacy programs for adults have been found to increase knowledge, improve attitudes, and increase help-seeking behaviors . Mental health literacy programs for caregivers have been found to increase caregiver knowledge and self-efficacy about managing their child’s mental health symptoms . Studies have found that stigma is decreased when mental health disorders are portrayed as treatable , when knowledge of mental illness is increased , and when help-seeking behaviors are enhanced [50, 54]. Peer influence and social norms also play an important role in decreasing stigma [46, 55]. Current DTC efforts to promote EBPs have been limited by a predominant focus on internet educational materials, academic conferences, and outreach presentations [24, 56]. All but one study  suggests that brief DTC educational videos increase knowledge, decrease stigma, and increase intention to seek psychological therapy [58,59,60,61]. Limitations of previous DTC research include the use of non-representative samples (including undergraduate and Amazon Mturk samples [52, 58,59,60,61], and for parent mental health literacy studies, lack of controlled designs .
Prior research has shown that DTC marketing effectiveness, mental health stigma, and barriers to treatment vary as a function of demographic factors (education, income, race/ethnicity), youth psychopathology religion, and history of mental health service use [29, 54, 58, 62,63,64,65,66,67,68]. Although individual experiences and demographic factors may impact the efficacy of DTC efforts, the majority of DTC efforts involve researchers or therapists spreading knowledge about EBPs without tailoring messaging to local contexts [24, 56].
Key opinion leaders
Involving a local caregiver key opinion leader (KOL) to tailor DTC initiatives may increase caregiver demand for EBPs. KOLs are trustworthy members of a local community who can use their social influence to enhance the relevance, acceptability, and credibility of DTC initiatives [69,70,71,72,73,74]. This benefit may be because people are more likely to use interventions that are used by people who are similar to them . KOLs often have a high degree of homophily (i.e., similarity between two individuals) to other members of their social group . Findings from a DTC marketing survey support this approach: results suggest that caregivers would prefer to receive more information about mental health treatments from other caregivers than they currently do . KOLs also could provide personal narratives about strategies used in CBT for youth anxiety, given that narrative stories increase comprehension, interest, and engagement when communicating science to nonexperts . In general, social support and encouragement from others facilitate treatment seeking and decrease stigma , and such encouragement is more influential when it comes from a KOL . This may be because KOLs increase the perceived subjective norms about seeking CBT (i.e., belief that other people also value seeking CBT), which would be a factor in predicting caregiver intention to seek CBT according to the theory of planned behavior .
KOLs have been found to be an effective strategy in communicating health messages both within healthcare settings and the community [73, 79,80,81]. Specifically, KOLs increase the likelihood of EBP implementation [73, 80], increase the dissemination of health information , and decrease stigma [81, 82]. The involvement of KOLs in DTC efforts harnesses the importance of social relationships in the diffusion of innovations . However, the role of KOLs to increase client demand for mental health EBPs has not been examined.
Project CHAT (Caregivers Hearing about Anxiety Treatments) will evaluate the effects of involving a caregiver KOL in the modification and presentation of an educational outreach presentation for caregivers on youth anxiety by comparing two approaches for outreach presentations about CBT. One presentation will be facilitated by a researcher and a KOL (KOL condition), and the other will be facilitated by two researchers (researcher-only condition). This study uses the theory of planned behavior (see Fig. 1) to evaluate the two presentation conditions. The theory of planned behavior states that attitudes about a behavior, perceived subjective norms about doing a behavior, and perceived behavioral control predict an individual’s intention to complete a behavior, which subsequently predicts their actual behavior . As shown in Fig. 1, stigma (an important barrier to treatment seeking [25, 27, 40]) is conceptualized as being related to both subjective norms and attitudes about CBT. This study will use a mixed methods approach (integrating quantitative and qualitative methods) to test the effect of KOLs on increasing caregiver demand for CBT for youth anxiety through the following aims.
Aim 1 (Primary aim)
Test the relative effects of researcher-only and KOL conditions on changing caregivers’ intention to seek CBT for their youth, and actual CBT seeking at 3-month follow-up.
Hypothesis 1a: Relative to the researcher-only condition, the KOL condition will result in a greater increase in caregiver intention to seek CBT with exposures for their youth.
Hypothesis 1b: Relative to the researcher-only condition, the KOL condition will result in a more caregivers seeking of CBT with exposures for their youth at the 3-month follow-up.
Aim 2 (Secondary aim)
Test the relative effects of researcher-only and KOL conditions on changing caregivers’ (a) perceived subjective norms about seeking CBT, (b) attitudes about CBT, (c) stigma about mental illness, and (d) knowledge of how to seek EBPs.
Hypothesis 2a: Relative to the researcher-only condition, the KOL condition will result in a greater (a) increase in subjective norms about seeking CBT, (b) improvement in attitudes about CBT, and (c) decrease in caregiver stigma about mental illness.
Hypothesis 2b: Both presentation conditions will result in a similar increase in knowledge about how to seek EBPs.
Aim 3 (Secondary Aim)
Examine how KOLs affect participants’ impression of the researcher presenter.
Hypothesis 3: Participants will view the principal investigator (i.e., the first author) more favorably when she presents with the KOL, relative to when she presents with another researcher.
Participants (N = 180) will be primary caregivers who are interested in seeking additional information about youth anxiety; specifically, caregivers who attend a presentation on youth anxiety at their youth’s school. Schools located in a metropolitan area in the northeastern United States will be recruited via their school mental health workers/other school administrators. School administrators will be contacted via email; local school partners (i.e., school psychologists and social workers) will assist with school recruitment as needed. To increase the racial, ethnic, and financial diversity of the sample, schools will only be contacted if they had at least 60% minority student enrollment or at least 60% of students eligible for school lunch . School administrators will advertise presentations as they advertise other school events (e.g., email list, Facebook groups). To be eligible for this study, participants must be least 18 years of age, be fluent in English, be the primary caregiver of a youth aged 5 to 18 years, and have a child at one of the schools offering a presentation. Caregivers will be cluster randomized by school using restricted randomization with Excel’s random number generator. Randomization will occur after the school has agreed to participate in the study, but before caregivers enroll in the study. The principal investigator (clinical psychology candidate with a master’s degree) will randomize schools to the presentation condition and will enroll all participants. Neither the researchers nor the participants are blinded to study condition. Participants will be paid $20 to attend the presentation and complete the pre- and post-presentation questionnaires; $10 to complete the 3-month follow-up questionnaire; and $20 for the qualitative interview.
Key opinion leaders
To select the KOLs, the principal investigator will contact the school parent-teacher association (or a similar parent group), and ask, “please nominate a caregiver who is well-known and respected within your community, and who reflects the diversity of the school as a whole.” If a school does not have an active parent-teacher association (or similar group of active parents), the school staff may select the KOL. The KOLs do not necessarily have to be a member of the parent-teacher association or have experience (professional or personal) with mental health. Previous research supports KOL nomination by knowledgeable community members (e.g., caregivers in the parent-teacher association) as a valid method for identifying trusted individuals in the community [74, 85]. The principal investigator will ask if the first KOL on the list is interested in participating in the project. The KOL must be willing to endorse CBT with exposures. Should the KOL decline to participate, the parent-teacher association will be asked to nominate a second caregiver KOL. There will be one KOL per school; the total number of KOLs will depend on the number of schools needed to recruit 180 caregiver participants.
KOLs from at least two schools in the KOL condition will participate in a 2-h feedback meeting with the principal investigator, with the goal of leveraging the KOLs to be champions of CBT. The KOLs will be sent a draft of the presentation to review prior to the meeting. During this meeting, the KOLs will discuss their experiences with youth anxiety, factors about their communities that may affect how anxiety symptoms present or are understood, and how caregivers in their community typically seek therapy. The principal investigator will review the presentation materials and encourage the KOLs to discuss their reactions and provide feedback. The KOLs will consider which strategies they can endorse as being effective (e.g., remaining calm when their child becomes emotional). Motivational interviewing techniques will be used should KOLs be skeptical about the value of CBT . The principal investigator will then modify the outreach presentation based on KOL feedback. Presentations will be modified separately for each school, so the KOLs who meet together do not need to come to consensus on presentation content. Following the group KOL feedback meeting, the principal investigator will meet with each KOL individually to review/approve the modifications made; answer remaining KOL questions about the content; determine which sections the KOL is comfortable presenting, and which strategies they are willing to endorse; and give the KOL the opportunity to practice. KOL meetings will take place via zoom. KOLs will be paid $40 per hour (5 h = $200 per KOL).
The KOL training checklist will be used to ensure that the KOL training is delivered consistently (see Additional file 1). The principal investigator will complete this checklist following the KOL training. She will mark whether the group training discussed KOL experiences with youth anxiety and reviewed the presentation materials, as well as whether the phone call reviewed modifications made to the presentation, allowed the KOL to ask questions, determined which parts of the presentation the KOL will present and which strategies the KOL will endorse, and allowed the KOL the chance to practice.
Caregivers in both conditions will be invited to an outreach presentation, which lasts 75 min with an additional 15 min for caregiver questions. Presentations will occur in the evening via Zoom, separate from parent-teacher association meetings. Each presentation will include information about identifying anxiety disorders, strategies for caregivers to help their youth with anxiety, CBT for youth anxiety, and strategies for finding a therapist who uses CBT with exposures. Exposure therapy will be emphasized given that exposure therapy is underutilized by therapists in the community despite being a core ingredient of CBT . The text on the presentations is written at a 5.3 grade reading level. Presentations will incorporate stigma reduction strategies, such as education to dispel myths, and behavioral decision-making tools to elicit hope, empowerment, and motivation [41, 88, 89]. Presentation content is manualized and is presented using PowerPoint.
Half the schools will be cluster randomized to receive a researcher-facilitated presentation, led by two clinical psychology graduate students (the principal investigator and another graduate student). Content will be the same for all schools randomized to the researcher-only condition. This is an active control condition. Researcher-facilitated outreach presentations are a current strategy research groups use to disseminate information to the community [24, 56, 90].
The other half of the schools will receive KOL co-facilitated presentations with the principal investigator (a clinical psychology PhD candidate). The KOLs will be introduced as a member from their school who has worked with the principal investigator to tailor the presentation to their community. Although the presentation is manualized and will contain the same core principles, content may vary by school in terms of specific examples and content emphasized based on KOL feedback. KOLs will be encouraged to share personal stories and examples of how the presentation material can apply to the school community to increase a sense of homophily to the KOL, as well as local relevance of the information.
Fidelity and manipulation checks
A 20-item Knowledge Test will assess caregivers’ knowledge of the content reviewed in the presentation (i.e., identifying anxiety disorders, strategies for caregivers to manage youth anxiety, EBPs to treat youth anxiety, and strategies for finding a therapist). The knowledge test is modeled after one to assess therapist training of CBT for anxiety . Questions are true/false and multiple-choice format. Responses will be coded such that 1 = correct and 0 = incorrect, for a maximum of 20 points. The Knowledge Test will be used as a manipulation check to test participants’ understanding of the presentation material.
A content checklist will assess the core components of the presentation (i.e., identifying anxiety disorders, strategies for caregivers to help their youth with anxiety, how anxiety is treated, and strategies for finding a CBT therapist). A research assistant will function as an independent evaluator to complete this measure and evaluate the content of the outreach presentations. The research assistant will code for presenter and audience member self-disclosure about experience receiving therapy for themselves or their child. The research assistant also will record the total amount of time each presenter speaks. Two research assistants will be present for at least 20% of presentations; interrater reliability of the evaluators (κ) will be calculated.
All questionnaires will be completed and stored on REDCap (a HIPAA secure platform ) hosted at Temple University. Participants will provide informed consent via REDCap before completing questionnaires. Figure 2 provides a summary of the schedule of enrolment, interventions, and assessments using the SPIRIT flow diagram . All measures that were created for Project CHAT are in Additional file 1 and are described below.
Treatment seeking evaluation
Pre- and post-presentation, caregivers will rate how likely they are to both seek a therapist for their child, as well as a therapist who uses exposure therapy, in the next 3 months. Rating scale ranges from 1 (very unlikely) to 5 (very likely). At the 3-month follow-up assessment, parents will be asked if they have sought therapy for their youth since the presentation. If so, they will be asked if the child has started therapy, if they requested a therapist who uses exposure therapy, and for the name of their child’s therapist.
Knowledge about seeking CBT
The Parent Engagement in Evidence-Based Services Questionnaire  is a 39-item measure of factors associated with seeking mental health care based on the theory of planned behavior . Caregivers rate each statement on a 5-point Likert scale ranging from 1 (strongly disagree) to 5 (strongly agree); some items are reverse coded. Caregiver ratings are summed to create five subscales ; this study will use the knowledge subscale to measure caregivers’ perceived understanding of how to seek EBPs (i.e., perceived behavioral control). On this subscale, higher scores indicate higher levels of perceived knowledge about seeking evidence-based practice. Evidence supports knowledge subscale’s internal consistency (α = .72) and convergent validity (r = .25–.41) .
The Parents’ Internalized Stigma of Mental Illness Scale  is a 10-item measure of caregiver perception of internalized stigma for having a youth with a mental illness. Caregivers rate each statement on a 4-point Likert scale ranging from 1 (strongly disagree) to 4 (strongly agree); some items are reverse coded. Higher scores indicate higher levels of family stigma. The Parents’ Internalized Stigma of Mental Illness Scale has acceptable internal consistency (α = .76). It is an adaptation of the well-validated Internalized Stigma of Mental Illness Scale [97, 98], which has demonstrated sensitivity to change in the expected direction after stigma reduction interventions .
Caregiver attitudes about cognitive behavioral therapy
The Caregiver Attitudes about CBT includes 18 strategies used in CBT for youth anxiety. Caregivers rate how helpful they believe each strategy would be for treating their child on a five-point scale ranging from 1 (very unhelpful) to 5 (very helpful). All items will be summed; higher scores indicate more favorable attitudes. Items were generated using an expert consensus (three clinical psychologists specializing in exposure treatment and one advanced doctoral candidate in clinical psychology). Some items were modeled on the Knowledge of Evidence-Based Services Questionnaire .
Therapy subjective norms
The Therapy Subjective Norms Questionnaire is a six-item measure of caregiver perception of subjective norms for seeking therapy. It was modeled from previously used measures of subjective norms [100, 101]. Caregivers rate each item on seven-point scale ranging from 1 (strongly disagree) to 7 (strongly agree). Three items assess injunctive norms (i.e., how other people would view an action the participant does; injunctive norms subscale), and three items assess descriptive norms (i.e., the participant’s view about what other people are doing; descriptive norms subscale). Items will be summed to create a score for overall subjective norms (all six items), as well as the injunctive and descriptive norms subscales; higher scores indicate more positive subjective norms about seeking therapy. Participants will complete two versions of this measure (12 items total): in one version, they will rate subjective norms related to seeking therapy, and in the other version, they will rate subjective norms related to seeking CBT.
Impression of presenters
On the Relatability Evaluation, caregivers will rate each presenter (the KOL and the researcher, or the two researchers) on the following 10 dimensions: relatability, likeability, similarity, similarity in thinking, similarity of beliefs, credibility, trustworthiness, understanding of the local community, familiarity, and friendship. Scores will be given on a scale ranging from 1 (strongly disagree) to 5 (strongly agree). These items are based on characteristics of homophily .
Barriers to seeking treatment
The Barriers to Seeking Treatment questionnaire asks participants to indicate whether they agree with 21 potential barriers to treatment (yes/no). This questionnaire is adapted from the Collaborative Psychiatric Epidemiology Studies  and includes items relating to attitudinal barriers (e.g., wanted to handle on their own, stigma) and structural barriers (e.g., cost, transportation) . Items were adapted to describe potential barriers caregivers may face (e.g., rather than saying “I need therapy,” the questionnaire was modified to read “my child needs therapy”).
The Brief Revised Child Anxiety and Depression Scale-Parent Version is a 25-item caregiver report measure of anxiety and depressive symptoms . Items are rated on a 4-point Likert scale from 0 (never) to 3 (always). It yields three scores: Total Anxiety, Total Depression, and Total Anxiety and Depression. This study will use the Total Anxiety score. Previous research supports the Brief Revised Child Anxiety and Depression Scale total anxiety subscale’s internal reliability (α = .80–.86), retest reliability (r = .85), convergent validity (r = .59), and discriminant validity for anxiety diagnoses (AUC = .81) .
Caregivers will evaluate their satisfaction with the presentation using the Client Satisfaction Questionnaire . This scale includes eight Likert scale questions and three short answer questions. On the Likert scale questions, caregivers will rate their level of satisfaction on a 4-point scale ranging from 1 to 4, with higher composite scores indicating greater program satisfaction. Psychometric analyses indicate excellent internal consistency (α = .93) and convergent validity (r = − .40–.23) .
Demographics and mental health history
A demographics questionnaire will assess caregiver and youth age, gender, race, ethnicity, and country of origin; caregiver level of education, income, and religious service attendance; and youth health insurance status. The presenters also will indicate their age, gender, country of origin, number of children, and level of education to assess their similarity to participants. On the mental health history questionnaire, participants will indicate whether they or their youth have ever been diagnosed with or treated for a mental disorder, whether they or their youth have received CBT with exposures, and their level of satisfaction with their youth’s previous treatment experience.
After participants have completed the 3-month follow-up questionnaire, 40 participants will be contacted to complete a qualitative interview via a Zoom videoconference. Participants will be purposefully sampled such that 20 participants who have sought treatment (10 per condition) and 20 who have not sought treatment (10 per condition) will be selected using Excel’s random number generator. Additional participants will be recruited until thematic saturation is reached .
Semi-structured interviews (see Additional file 1 for the interview guide) will be conducted by undergraduate research assistants (N = 3) using a funnel approach, with open ended questions followed by specific required and optional probes for details . Interviews will elicit information about barriers to seeking treatment, and the role of the presentation in reducing those barriers. Primary topics will include: (1) their perception of the presenters; (2) ways in which the presenters affected their decision to seek treatment; (3) factors they considered when seeking treatment; (4) strategies they have used from the presentation; (5) their perception of exposure therapy; and (6) general ways that the mental health system could be improved to improve access to therapy. Interviews will close with a question asking for general additional feedback. Interviews will last approximately 30 min and will be digitally recorded via Zoom.
After each interview, the interviewer will rate the participant’s level of interest and involvement in answering the questions (1 = very low to 5 = very high), their understanding of the interview (1 = limited to 5 = complete), and their impression of the participant’s knowledge of the topics discussed (1 = highly questionable to 5 = highly knowledgeable). The interviewer also will comment on discrepancies in the interview and circumstances that may have affected quality of responses. Zoom transcripts of the interviews will be used, and a research assistant will check the transcription for accuracy. Transcripts will be deidentified.
The primary analytic tool will be multilevel modeling using maximum likelihood estimation, which provides unbiased parameter estimates when data are missing at random. The missing at random assumption will be tested by multiple logistic regression analyses examining whether key predictors at baseline (i.e., Knowledge Test, Parent Engagement in Evidence-Based Services Questionnaire–Knowledge subscale, Parents’ Internalized Stigma of Mental Illness Scale, Therapy Subjective Norms, Caregiver Attitudes about CBT, Treatment Seeking Evaluation, and demographics) are associated with study retention. Should analyses reveal that dropout is differentially associated with outcomes, multiple imputation will be used [108,109,110]. Every effort will be made to prevent missing data, such as by using REDCap options that remind participants to answer blank questions, and by emailing participants who have not completed all questionnaires.
For Primary Aim 1, a Monte Carlo-based power estimate was derived using Mplus with 10,000 replications. For the sample size of 180, assuming a Type I error rate of 5%, a two-tailed test, statistical power was .83 to detect a medium-sized effect (r = .30) of randomization group on longitudinal changes, given an expectation of a small (r = .15) effect for the control group. For Primary Aim 2, power was calculated using G*Power. Given the brevity of the 3-month follow-up questionnaire, a 10% attrition rate was assumed. Assuming a Type I error rate of 5%, a two-tailed test, and a 25% rate of seeking CBT in the researcher-only condition, statistical power was .82 to detect a medium effect (odd ratio = 1.72).
Data analysis and interpretation
Quantitative analyses will use multilevel modeling to account for the nesting of repeated measures within caregivers. Preliminary analyses will examine the effect of clustering of caregivers within schools. If schools account for more than 10% of variance in the outcomes after controlling for condition, a three-level multilevel model will be used to account for nesting of repeated measures within caregivers within schools.
Analyses will consider intention to seek CBT with exposures (Treatment Seeking Evaluation - Intention to seek CBT), subjective norms about seeking CBT (Therapy Subjective Norms Questionnaire–CBT), attitudes about CBT (Caregiver Attitudes about CBT), caregiver stigma about mental illness (Parents’ Internalized Stigma of Mental Illness Scale), and knowledge about how to seek EBPs for youth anxiety (Parent Engagement in Evidence-Based Services Questionnaire–Knowledge Subscale) as person-level dependent factors; condition (caregiver or researcher co-facilitator) as a person-level predictor; and time (pre- and post-presentation) as an observation-level predictor. In separate multilevel models, (a) intention to seek CBT, (b) Therapy Subjective Norms Questionnaire–CBT, (c) Caregiver Attitudes about CBT, (d) Parents’ Internalized Stigma of Mental Illness Scale, and (e) Parent Engagement in Evidence-Based Services Questionnaire–Knowledge subscale will be regressed on time, condition, and the interaction between time and condition; a random intercept will be included in all five multilevel models. A binary logistic regression will be conducted with CBT service seeking at the 3-month follow-up (Treatment Seeking Evaluation - Actual CBT seeking) entered as the dependent variable, condition entered as the independent variable, and youth anxiety (Brief Revised Child Anxiety and Depression Scale–Total Anxiety) entered as a control variable. T-tests will be used to compare difference between conditions for each item on the Relatability Evaluation of the principal investigator. This study will examine caregiver demographic factors, youth anxiety (Brief Revised Child Anxiety and Depression Scale–Total Anxiety), racial similarity to the presenter (Demographics, same race), and self-disclosure (Content Checklist, self-disclosure) as potential moderators of the effect of presentation condition on intention to seek CBT. In separate multilevel models, intention to seek CBT will be regressed on time, condition, each potential moderators, and their three-way interaction.
The transcribed qualitative interviews will be entered into NVivo software for analysis. Qualitative analyses will use a direct content analysis approach . The coding team will create an initial codebook using the primary topics asked in the qualitative interviews. Additional codes will be added to code text that does not fit into the initial categories, to split the initial codes into two, or to create new codes. Coding will occur through a consensus process in which each transcript will be coded independently by two raters, who will arrive at consensus through discussion as needed . Thematic responses will be examined by both condition and by whether the caregiver has sought treatment for their youth (4 groups total).
Mixed methods integration will follow a QUAN ➔ qual structure with an expansion approach ; quantitative methods are used to test hypotheses about the intervention and qualitative methods are used to contextual the results.
The Institutional Review Board at Temple University has approved all study procedures. Recruitment and data collection for this study began in May 2021. At the time of publication, 17 participants attended the presentation and completed the post-presentation assessment; 4 participants have completed the 3-month follow-up data collection.
Considerations and limitations
Several considerations were made in selecting the study methods. First, we considered recruiting KOLs with lived experience as a parent of a child with anxiety; contact strategies with individuals with lived experience are a common strategy to destigmatize mental illness . However, we determined that individuals with lived experience and KOLs may be two different groups of people, and thus we decided not to require lived experience among KOLs. Future research could compare KOLs versus individuals with lived experience for increasing the caregiver demand of EBPs. Second, we considered whether school staff could select KOLs. However, we decided that fellow caregivers would likely have a better sense of which caregivers were respected by their peers, rather than the caregivers known to school staff. The limitation of this approach is that some schools may not have active parent-teacher association (or similar parent groups), thus limiting the feasibility of a consistent KOL selection process. Third, we set the follow-up period as 3 months to give individuals enough time to seek treatment, but not too much time such that they would forget aspects of the presentation that will be discussed in the qualitative interviews. A limitation of this approach is that it is possible that caregivers may take more than 3 months to seek treatment for their child, which will not be captured by this research study. Fourth, the impact of COVID-19 on both schools and families may negatively affect recruitment of schools and caregivers. To mitigate this challenge, the research team has established partnerships with school mental health workers who are assisting with school recruitment.
This project will evaluate a DTC strategy to increase caregiver seeking of CBT for youth anxiety. Most dissemination and implementation efforts examine strategies to increase the use of CBT by providers . However, these efforts do not necessarily affect initial treatment seeking . Educational outreach strategies are used to increase demand for EBPs [24, 56, 90], but their efficacy has yet to be evaluated. Further, although exciting work has begun to examine DTC efforts for increasing demand of EBPs [58,59,60,61, 65], no study has examined the effect of DTC efforts on actual treatment seeking behavior. Additionally, although research indicates that KOLs improve health promotion campaigns , their efficacy in increasing uptake of EBPs in clinical psychology has not been examined. Previous research on patient and public involvement in research has largely been qualitative, and randomized trials have focused only on one type of engagement outcome, such as participant recruitment . This project also will examine how the presence of a local stakeholder (i.e., a KOL) affects participants’ perceptions of a researcher. Together, the findings from the study will inform future dissemination initiatives to increase client demand for EBPs.
Availability of data and materials
Cognitive behavioral therapy
Key opinion leader
- Project CHAT:
Caregivers Hearing about Anxiety Treatments
Cartwright-Hatton S, McNicol K, Doubleday E. Anxiety in a neglected population: Prevalence of anxiety disorders in pre-adolescent children. Clin Psychol Rev. 2006;26(7):817–33. https://doi.org/10.1016/j.cpr.2005.12.002.
Kessler RC, Berglund P, Demler O, Jin R, Merikangas KR, Walters EE. Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the National Comorbidity Survey Replication. Arch of Gen Psychiatry. 2005;62(6):593–602. https://doi.org/10.1001/archpsyc.62.6.593.
Kendall PC, Safford S, Flannery-Schroeder E, Webb A. Child anxiety treatment: Outcomes in adolescence and impact on substance use and depression at 7.4-year follow-up. J Consult Clin Psych. 2004;72(2):276–87. https://doi.org/10.1037/0022-006x.72.2.276.
Rudd MD, Joiner TE, Rumzek H. Childhood diagnoses and later risk for multiple suicide attempts. Suicide Life-threat. 2004;34(2):113–25. https://doi.org/10.1521/suli.184.108.40.206784.
Swan AJ, Kendall PC. Fear and missing out: youth anxiety and functional outcomes. Clin Psychology Sci Pract. 2016;23(4):417–35. https://doi.org/10.1111/cpsp.12169.
Wolk CB, Kendall PC, Beidas RS. Cognitive-behavioral therapy for child anxiety confers long-term protection from suicidality. J Am Acad Child Adolesc Psychiatry. 2015;54(3):175–9. https://doi.org/10.1016/j.jaac.2014.12.004.
Woodward LJ, Fergusson DM. Life course outcomes of young people with anxiety disorders in adolescence. J Am Acad Child Adolesc Psychiatry. 2001;40(9):1086–93. https://doi.org/10.1097/00004583-200109000-00018.
Bodden DHM, Dirksen CD, Bögels SM. Societal burden of clinically anxious youth referred for treatment: a cost-of-illness study. J Abnorm Child Psych. 2008;36(4):487–97. https://doi.org/10.1007/s10802-007-9194-4.
Konnopka A, Leichsenring F, Leibing E, König H-H. Cost-of-illness studies and cost-effectiveness analyses in anxiety disorders: a systematic review. J Affect Disorders. 2009;114(1-3):14–31. https://doi.org/10.1016/j.jad.2008.07.014.
Moitra E, Beard C, Weisberg RB, Keller MB. occupational impairment and social anxiety disorder in a sample of primary care patients. J Affect Disorders. 2011;130(1-2):209–12. https://doi.org/10.1016/j.jad.2010.09.024.
Higa-McMillan CK, Francis SE, Rith-Najarian L, Chorpita BF. Evidence base update: 50 years of research on treatment for child and adolescent anxiety. J Clin Child Adolesc Psychology. 2015;45(2):91–113. https://doi.org/10.1080/15374416.2015.1046177.
Kendall PC, Robin JA, Hedtke KA, Suveg C, Flannery-Schroeder E, Gosch E. Considering CBT with anxious youth? Think exposures. Cogn Behav Pract. 2005;12(1):136–48. https://doi.org/10.1016/s1077-7229(05)80048-3.
Weisz JR, Kuppens S, Ng MY, Eckshtain D, Ugueto AM, Vaughn-Coaxum R, et al. What five decades of research tells us about the effects of youth psychological therapy: a multilevel meta-analysis and implications for science and practice. Am Psychol. 2017;72(2):79–117. https://doi.org/10.1037/a0040360.
McHugh RK, Barlow DH. The dissemination and implementation of evidence-based psychological treatments. Am Psychol. 2010;65(2):73–84. https://doi.org/10.1037/a0018121.
Merikangas KR, He J, Burstein ME, Swendsen J, Avenevoli S, Case B, et al. Service utilization for lifetime mental disorders in U.S. adolescents: results of the National Comorbidity Survey Adolescent Supplement (NCS-A). J Am Acad Child Adolesc Psychiatry. 2011;50(1):32–45. https://doi.org/10.1016/j.jaac.2010.10.006.
Shafran R, Clark DM, Fairburn CG, Arntz A, Barlow DH, Ehlers A, et al. Mind the gap: improving the dissemination of CBT. Behav Res Ther. 2009;47(11):902–9. https://doi.org/10.1016/j.brat.2009.07.003.
Purtle J, Marzalik JS, Halfond RW, Bufka LF, Teachman BA, Aarons GA. Toward the data-driven dissemination of findings from psychological science. Am Psychol. 2020;75(8):1052–66. https://doi.org/10.1037/amp0000721.
Powell BJ, Waltz TJ, Chinman MJ, Damschroder LJ, Smith JL, Matthieu MM, et al. A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project. Implement Sci. 2015;10(1):21. https://doi.org/10.1186/s13012-015-0209-1.
Leeman J, Birken SA, Powell BJ, Rohweder C, Shea CM. Beyond “implementation strategies”: classifying the full range of strategies used in implementation science and practice. Implementation Science. 2017;12(1):1–9. https://doi.org/10.1186/s13012-017-0657-x.
Becker SJ. Direct-to-consumer marketing: a complementary approach to traditional dissemination and implementation efforts for mental health and substance abuse interventions. Clin Psychology Sci Pract. 2015;22(1):85–100. https://doi.org/10.1111/cpsp.12086.
Friedberg RD, Bayar H. If it works for pills, can it work for skills? Direct-to-consumer social marketing of evidence-based psychological treatments. Psychiatr Serv. 2017;68(6):621–3. https://doi.org/10.1176/appi.ps.201600153.
Berridge BJ, McCann TV, Cheetham A, Lubman DI. Perceived barriers and enablers of help-seeking for substance use problems during adolescence. Heal Promot Pract. 2018;19(1):86–93. https://doi.org/10.1177/1524839917691944.
Kang AW, Escobar K, Tavares T, Helseth SA, Kelly LM, Becker SJ. Therapy-seeking behavior among parents concerned about their adolescent’s substance use. Subst Abus. 2019;40(4):1–7. https://doi.org/10.1080/08897077.2019.1621240.
Gallo KP, Comer JS, Barlow DH. Direct-to-consumer marketing of psychological treatments for anxiety disorders. J Anxiety Disord. 2013;27(8):793–801. https://doi.org/10.1016/j.janxdis.2013.03.005.
Gulliver A, Griffiths KM, Christensen H. Perceived barriers and facilitators to mental health help-seeking in young people: a systematic review. BMC Psychiatry. 2010;10(1):113. https://doi.org/10.1186/1471-244x-10-113.
Henderson C, Evans-Lacko S, Thornicroft G. Mental illness stigma, help seeking, and public health programs. Am J Public Health. 2013;103(5):777–80. https://doi.org/10.2105/ajph.2012.301056.
Owens PL, Hoagwood K, Horwitz SM, Leaf PJ, Poduska JM, Kellam SG, et al. Barriers to children’s mental health services. J Am Acad Child Adolesc Psychiatry. 2002;41(6):731–8. https://doi.org/10.1097/00004583-200206000-00013.
Ryan SM, Jorm AF, Toumbourou JW, Lubman DI. Parent and family factors associated with service use by young people with mental health problems: a systematic review. Early Interv Psychia. 2015;9(6):433–46. https://doi.org/10.1111/eip.12211.
Green JG, McLaughlin KA, Fillbrunn M, Fukuda M, Jackson JS, Kessler RC, et al. Barriers to mental health service use and predictors of treatment drop out: racial/ethnic variation in a population-based study. Adm Policy Ment Hlth. 2020;47(4):606–16. https://doi.org/10.1007/s10488-020-01021-6.
Andrade LH, Alonso J, Mneimneh Z, Wells JE, Al-Hamzawi A, Borges G, et al. Barriers to mental health treatment: results from the WHO World Mental Health surveys. Psychol Med. 2014;44(6):1303–17. https://doi.org/10.1017/s0033291713001943.
Jorm AF. Mental health literacy. Am Psychol. 2012;67(3):231–43. https://doi.org/10.1037/a0025957.
Oh E, Bayer JK. Predicting parents’ intentions to seek help for young children’s mental health. Int J Ment Health Promot. 2017;19(1):38–49. https://doi.org/10.1080/14623730.2016.1276024.
Thurston IB, Phares V, Coates EE, Bogart LM. Child problem recognition and help-seeking intentions among black and white parents. J Clin Child Adolesc Psychology. 2015;44(4):604–15. https://doi.org/10.1080/15374416.2014.883929.
Pescosolido BA, Jensen PS, Martin JK, Perry BL, Olafsdottir S, Fettes D. Public knowledge and assessment of child mental health problems: Findings from the National Stigma Study-Children. J Am Acad Child Adolesc Psychiatry. 2008;47(3):339–49. https://doi.org/10.1097/CHI.0b013e318160e3a0.
Coles ME, Coleman SL. Barriers to treatment seeking for anxiety disorders: initial data on the role of mental health literacy. Depress Anxiety. 2010;27(1):63–71. https://doi.org/10.1002/da.20620.
Jorm AF. Mental health literacy: public knowledge and beliefs about mental disorders. B J Psych. 2000;117(5):396–401. https://doi.org/10.1192/bjp.177.5.396.
Jorm AF, Korten AE, Jacomb PA. Mental health literacy: a survey of the public’s ability to recognise mental disorders and their beliefs about the effectiveness of treatment. Med J Aust. 1997;166(4):182–6. https://doi.org/10.5694/j.1326-5377.1997.tb140071.x.
Kazdin AE, Rabbitt SM. Novel models for delivering mental health services and reducing the burdens of mental illness. Clin Psychological Sci. 2013;1(2):170–91. https://doi.org/10.1177/2167702612463566.
Langer DA, Jensen-Doss A. Shared decision-making in youth mental health care: Using the evidence to plan treatments collaboratively. J Clin Child Adolesc Psychol. 2018;47(5):1–11. https://doi.org/10.1080/15374416.2016.1247358.
Corrigan PW. How stigma interferes with mental health care. Am Psychol. 2004;59(7):614–25. https://doi.org/10.1037/0003-066X.59.7.614.
Larson JE, Corrigan P. The stigma of families with mental illness. Acad Psychiatr. 2008;32(2):87–91. https://doi.org/10.1176/appi.ap.32.2.87.
Mukolo A, Heflinger CA, Wallston KA. The stigma of childhood mental disorders: a conceptual framework. J Am Acad Child Adolesc Psychiatry. 2010;49(2):92–103. https://doi.org/10.1016/j.jaac.2009.10.011.
Eaton K, Ohan JL, Stritzke WGK, Corrigan PW. Failing to meet the good parent ideal: Self-stigma in parents of children with mental health disorders. J Child Fam Stud. 2016;25(10):3109–23. https://doi.org/10.1007/s10826-016-0459-9.
Francis A. Stigma in an era of medicalisation and anxious parenting: how proximity and culpability shape middle-class parents’ experiences of disgrace. Sociol Health Ill. 2012;34(6):927–42. https://doi.org/10.1111/j.1467-9566.2011.01445.x.
Clement S, Schauman O, Graham T, Maggioni F, Evans-Lacko S, Bezborodovs N, et al. What is the impact of mental health-related stigma on help-seeking? A systematic review of quantitative and qualitative studies. Psychol Med. 2015;45(1):11–27. https://doi.org/10.1017/s0033291714000129.
Corrigan PW, Druss BG, Perlick DA. The impact of mental illness stigma on seeking and participating in mental health care. Psychol Sci Publ Int. 2014;15(2):37–70. https://doi.org/10.1177/1529100614531398.
Vogel DL, Wade NG, Hackler AH. Perceived public stigma and the willingness to seek counseling: The mediating roles of self-stigma and attitudes toward counseling. J Couns Psychol. 2007;54(1):40–50. https://doi.org/10.1037/0022-0220.127.116.11.
Collins RL, Wong EC, Breslau J, Burnam MA, Cefalu M, Roth E. Social marketing of mental health treatment: California’s mental illness stigma reduction campaign. Am J Public Health. 2019;109(S3):S228–35. https://doi.org/10.2105/ajph.2019.305129.
Dempster R, Wildman B, Keating A. The role of stigma in parental help-seeking for child behavior problems. J Clin Child Adolesc Psychol. 2013;42(1):56–67. https://doi.org/10.1080/15374416.2012.700504.
Evans-Lacko S, Brohan E, Mojtabai R, Thornicroft G. Association between public views of mental illness and self-stigma among individuals with mental illness in 14 European countries. Psychol Med. 2012;42(8):1741–52. https://doi.org/10.1017/s0033291711002558.
Hadlaczky G, Hökby S, Mkrtchian A, Carli V, Wasserman D. Mental Health First Aid is an effective public health intervention for improving knowledge, attitudes, and behaviour: A meta-analysis. Int Rev Psychiatr. 2014;26(4):467–75. https://doi.org/10.3109/09540261.2014.924910.
Hurley D, Swann C, Allen MS, Ferguson HL, Vella SA. A systematic review of parent and caregiver mental health literacy. Commun Ment Hlt J. 2020;56(1):2–21. https://doi.org/10.1007/s10597-019-00454-0.
Mittal D, Sullivan G, Chekuri L, Allee E, Corrigan PW. Empirical studies of self-stigma reduction strategies: a critical review of the literature. Psychiatr Serv. 2012;63(10):974–81. https://doi.org/10.1176/appi.ps.201100459.
Turner EA, Liew J. Children’s adjustment and child mental health service use: the role of parents’ attitudes and personal service use in an upper middle class sample. Commun Ment Hlt J. 2010;46(3):231–40. https://doi.org/10.1007/s10597-009-9221-8.
Pescosolido BA, Martin JK, Lang A, Olafsdottir S. Rethinking theoretical approaches to stigma: A Framework Integrating Normative Influences on Stigma (FINIS). Soc Sci Med. 2008;67(3):431–40. https://doi.org/10.1016/j.socscimed.2008.03.018.
Szymanski J. Using direct-to-consumer marketing strategies with obsessive-compulsive disorder in the nonprofit sector. Behav Ther. 2012;43(2):251–6. https://doi.org/10.1016/j.beth.2011.05.005.
Morawska A, Nitschke F, Burrows S. Do testimonials improve parental perceptions and participation in parenting programmes? Results of two studies. J Child Health Care. 2011;15(2):85–98. https://doi.org/10.1177/1367493510397625.
Barnett ML, Bernal NA, Sanchez BEL. Direct-to-consumer marketing for parent-child interaction therapy: impact of language and messenger. J Child Fam Stud. 2020;29(1):71–81. https://doi.org/10.1007/s10826-019-01575-6.
Brecht K, Swift JK, Worrall JM, Parkin SR. A randomized controlled test of direct-to-consumer marketing using the American Psychological Association psychotherapy works videos. Prof Psychology Res Pract. 2010;48(6):421–8. https://doi.org/10.1037/pro0000167.
Gallo KP, Comer JS, Barlow DH, Clarke RN, Antony MM. Direct-to-consumer marketing of psychological treatments: a randomized controlled trial. J Consult Clin Psych. 2015;83(5):994–8. https://doi.org/10.1037/a0039470.
Ponzini GT, Schofield CA. Randomized controlled trials evaluating the effectiveness of a direct-to-consumer marketing campaign for social anxiety disorder. Stigma Heal. 2019;4(4):450–61. https://doi.org/10.1037/sah0000163.
Helseth SA, Escobar KI, Clark MA, Spirito A, Becker SJ. Marketing therapy to parents concerned about adolescent substance use: association of adolescent problems and parent preferences for direct-to-consumer marketing. Prof Psychol Res Pract. 2020;51(1):68–76. https://doi.org/10.1037/pro0000255.
Becker SJ, Weeks BJ, Escobar KI, Moreno O, DeMarco CR, Gresko SA. Impressions of “evidence-based practice”: a direct-to-consumer survey of caregivers concerned about adolescent substance use. Evid Based Pract Child Adolesc Ment Heal. 2018;3(2):70–80. https://doi.org/10.1080/23794925.2018.1429228.
Becker SJ, Helseth SA, Frank HE, Escobar KI, Weeks BJ. Parent preferences and experiences with psychological treatment: results from a direct-to-consumer survey using the marketing mix framework. Prof Psychol Res Pract. 2018;49(2):167–76. https://doi.org/10.1037/pro0000186.
Becker SJ, Helseth SA, Tavares TL, Squires DD, Clark MA, Zeithaml VA, et al. User-informed marketing versus standard description to drive demand for evidence-based therapy: a randomized controlled trial. Am Psychol. 2020;75(8):1038–51. https://doi.org/10.1037/amp0000635.
Taylor RE, Kuo BCH. Black American psychological help-seeking intention: an integrated literature review with recommendations for clinical practice. J Psychother Integr. 2019;29(4):325–37. https://doi.org/10.1037/int0000131.
Turner EA, Jensen-Doss A, Heffer RW. Ethnicity as a moderator of how parents’ attitudes and perceived stigma influence intentions to seek child mental health services. Cultur Divers Ethnic Minor Psychol. 2015;21(4):613–8. https://doi.org/10.1037/cdp0000047.
Crane ME, Helseth SA, Scott K, Becker SJ. Adolescent behavioral health problems are associated with parent perceptions of evidence-based therapy and preferences when seeking therapeutic support. Prof Psychol Res Pract. 2021;52(2):130–6. https://doi.org/10.1037/pro0000361.
Daniels AS, Bergeson S, Myrick KJ. Defining peer roles and status among community health workers and peer support specialists in integrated systems of care. Psychiatr Serv. 2017;68(12):1296–8. https://doi.org/10.1176/appi.ps.201600378.
Frazier SL, Abdul-Adil J, Atkins MS, Gathright T, Jackson M. Can’t have one without the other: mental health providers and community parents reducing barriers to services for families in urban poverty. J Community Psychol. 2007;35(4):435–46. https://doi.org/10.1002/jcop.20157.
Gustafson EL, Atkins M, Rusch D. Community health workers and social proximity: Implementation of a parenting program in urban poverty. Am J Commun Psychol. 2018;62(3-4):449–63. https://doi.org/10.1002/ajcp.12274.
Rusch D, Walden AL, Gustafson E, Lakind D, Atkins MS. A qualitative study to explore paraprofessionals’ role in school-based prevention and early intervention mental health services. J Community Psychol. 2018;47(2):272–90. https://doi.org/10.1002/jcop.22120.
Flodgren G, O’Brien MA, Parmelli E, Grimshaw JM. Local opinion leaders: effects on professional practice and healthcare outcomes. Cochrane Db Syst Rev. 2019;2019(6):CD000125. https://doi.org/10.1002/14651858.cd000125.pub5.
Valente TW, Pumpuang P. Identifying opinion leaders to promote behavior change. Health Educ Behav. 2006;34(6):881–96. https://doi.org/10.1177/1090198106297855.
Neal JW, Neal ZP, Atkins MS, Henry DB, Frazier SL. Channels of Change: Contrasting network mechanisms in the use of interventions. Am J Commun Psychol. 2011;47(3-4):277–86. https://doi.org/10.1007/s10464-010-9403-0.
Rogers EM. Diffusion of innovations. 5th ed. Free Press; 2003. https://www.amazon.com/Diffusion-Innovations-5th-Everett-Rogers/dp/0743222091.
Dahlstrom MF. Using narratives and storytelling to communicate science with nonexpert audiences. Proc National Acad Sci. 2014;111(Supplement_4):13614–20. https://doi.org/10.1073/pnas.1320645111.
Ajzen I. The theory of planned behavior. Organ Behav Hum. 1991;50(2):179–211. https://doi.org/10.1016/0749-5978(91)90020-t.
Li L, Lin C, Guan J, Wu Z. Implementing a stigma reduction intervention in healthcare settings. J Int Aids Soc. 2013;16(3 Suppl 2):18710. https://doi.org/10.7448/ias.16.3.18710.
Atkins MS, Frazier SL, Leathers SJ, Graczyk PA, Talbott E, Jakobsons L, et al. Teacher key opinion leaders and mental health consultation in low-income urban schools. J Consult Clin Psych. 2008;76(5):905–8. https://doi.org/10.1037/a0013036.
Nelson A. Ups and Downs: social media advocacy of bipolar disorder on world mental health day. Frontiers Commun. 2019;4:24. https://doi.org/10.3389/fcomm.2019.00024.
Li L, Wu Z, Liang L-J, Lin C, Guan J, Jia M, et al. Reducing HIV-related stigma in health care settings: a randomized controlled trial in China. Am J Public Health. 2013;103(2):286–92. https://doi.org/10.2105/ajph.2012.300854.
Berwick DM. Disseminating innovations in health care. JAMA. 2003;289(15):1969–75. https://doi.org/10.1001/jama.289.15.1969.
Public School Review [Internet]. 2021. https://www.publicschoolreview.com.
Rogers EM, Cartano DG. Methods of measuring opinion leadership. Public Opinion Quarterly. 1962;26(3):435–41. https://doi.org/10.2307/2747233.
Miller WR, Rollnick S. Motivational Interviewing: helping People Change. Third: Guilford Press; 2012.
Chu BC, Crocco ST, Arnold CC, Brown R, Southam-Gerow MA, Weisz JR. Sustained implementation of cognitive-behavioral therapy for youth anxiety and depression: long-term effects of structured training and consultation on therapist practice in the field. Prof Psychol Res Pract. 2015;46(1):70–9. https://doi.org/10.1037/a0038000.
Pettigrew TF, Tropp LR. How does intergroup contact reduce prejudice? Meta-analytic tests of three mediators. Eur J Soc Psychol. 2008;38(6):922–34. https://doi.org/10.1002/ejsp.504.
Yanos PT, Lucksted A, Drapalski AL, Roe D, Lysaker P. Interventions targeting mental health self-stigma: a review and comparison. Psychiatr Rehabil J. 2015;38(2):171–8. https://doi.org/10.1037/prj0000100.
Powell BJ, McMillen JC, Proctor EK, Carpenter CR, Griffey RT, Bunger AC, et al. A compilation of strategies for implementing clinical innovations in health and mental health. Med Care Res Rev. 2011;69(2):123–57. https://doi.org/10.1177/1077558711430690.
Beidas RS, Bamish AJ, Kendall PC. Training as usual: can therapist behavior change after reading a manual and attending a brief workshop on cognitive behavioral therapy for youth anxiety? the. Behavior Therapist. 2009;5:97–101.
Harris PA, Taylor R, Minor BL, Elliott V, Fernandez M, O’Neal L, et al. The REDCap Consortium: building an international community of software platform partners. J Biomed Inform. 2019;95:103208. https://doi.org/10.1016/j.jbi.2019.103208.
Chan A-W, Tetzlaff JM, Altman DG, Laupacis A, Gøtzsche PC, Krleža-Jerić K, et al. SPIRIT 2013 Statement: defining standard protocol items for clinical trials. Ann Intern Med. 2013;158(3):200–7. https://doi.org/10.7326/0003-4819-158-3-201302050-00583.
Chang JP, Orimoto TE, Burgess A, Choy SKJ, Nakamura BJ. The theory of planned behavior applied to consumer engagement in evidence-based services. J Child Fam Stud. 2019;28(11):2963–76. https://doi.org/10.1007/s10826-019-01472-y.
Choy SKJ, Chang JP, Nakamura BJ. The Parent Engagement in Evidence-Based Services Questionnaire: advancing our understanding of parental intentions for engaging in evidence-based practice. In: Presented at the Society for Implementation Research Collaboration; 2019.
Zisman-Ilani Y, Levy-Frank I, Hasson-Ohayon I, Kravetz S, Mashiach-Eizenberg M, Roe D. Measuring the internalized stigma of parents of persons with a serious mental illness. J Nerv Ment Dis. 2013;201(3):183–7. https://doi.org/10.1097/nmd.0b013e3182845d00.
Boyd JE, Adler EP, Otilingam PG, Peters T. Internalized Stigma of Mental Illness (ISMI) Scale: a multinational review. Compr Psychiat. 2014;55(1):221–31. https://doi.org/10.1016/j.comppsych.2013.06.005.
Ritsher JB, Otilingam PG, Grajales M. Internalized stigma of mental illness: psychometric properties of a new measure. Psychiat Res. 2003;121(1):31–49. https://doi.org/10.1016/j.psychres.2003.08.008.
Stumpf RE, Higa-McMillan CK, Chorpita BF. Implementation of evidence-based services for youth. Behav Modif. 2008;33(1):48–65. https://doi.org/10.1177/0145445508322625.
Park HS, Smith SW. Distinctiveness and influence of subjective norms, personal descriptive and injunctive norms, and societal descriptive and injunctive norms on behavioral intent: a case of two behaviors critical to organ donation. Hum Commun Res. 2007;33(2):194–218. https://doi.org/10.1111/j.1468-2958.2007.00296.x.
Glanz K, Rimer BK, Viswanath K. Health Behavior and Health Education: Theory, Research, and Practice. 4th ed: John Wiley & Sons; 2008.
McCroskey JC, Richmond VP, Daly JA. The development of a measure of perceived homophily in interpersonal communication. Hum Commun Res. 1975;1(4):323–32. https://doi.org/10.1111/j.1468-2958.1975.tb00281.x.
Heeringa SG, Wagner J, Torres M, Duan N, Adams T, Berglund P. Sample designs and sampling methods for the Collaborative Psychiatric Epidemiology Studies (CPES). Int J Method Psych. 2004;13(4):221–40. https://doi.org/10.1002/mpr.179.
Ebesutani C, Korathu-Larson P, Nakamura BJ, Higa-McMillan C, Chorpita B. The Revised Child Anxiety and Depression Scale 25–Parent Version: Scale development and validation in a school-based and clinical sample. Assessment. 2017;24(6):712–28. https://doi.org/10.1177/1073191115627012.
Attkisson CC, Zwick R. The Client Satisfaction Questionnaire: psychometric properties and correlations with service utilization and psychotherapy outcome. Eval Program Plann. 1982;5(3):233–7. https://doi.org/10.1016/0149-7189(82)90074-X.
Guest G, Bunce A, Johnson L. How many interviews are enough? Field Method. 2006;18:59–82. https://doi.org/10.1177/1525822×05279903.
Spradley J. The ethnographic interview. Inc.: Waveland Press; 1979.
Enders CK. Multiple imputation as a flexible tool for missing data handling in clinical research. Behav Res Ther. 2017;98:4–18. https://doi.org/10.1016/j.brat.2016.11.008.
Graham JW. Missing data analysis: making it work in the real world. Annu Rev Psychol. 2009;60(1):549–76. https://doi.org/10.1146/annurev.psych.58.110405.085530.
Schafer JL, Graham JW. Missing data: our view of the state of the art. Psychol Med. 2002;7:147–77.
Hsieh H-F, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res. 2016;15(9):1277–88. https://doi.org/10.1177/1049732305276687.
Hill CE, Knox S, Thompson BJ, Williams EN, Hess SA, Ladany N. Consensual qualitative research: An update. J Couns Psychol. 2005;52(2):196–205. https://doi.org/10.1037/0022-018.104.22.168.
Palinkas LA, Aarons GA, Horwitz S, Chamberlain P, Hurlburt M, Landsverk J. Mixed method designs in implementation research. Adm Policy Ment Hlth. 2010;38(1):44–53. https://doi.org/10.1007/s10488-010-0314-z.
Corrigan PW, Morris SB, Michaels PJ, Rafacz JD, Rüsch N. Challenging the public stigma of mental illness: a meta-analysis of outcome studies. Psychiatr Serv. 2012;63(10):963–73. https://doi.org/10.1176/appi.ps.201100529.
Forsythe LP, Carman KL, Szydlowski V, Fayish L, Davidson L, Hickam DH, et al. Patient engagement in research: early findings from the patient-centered outcomes research institute. Health Affair. 2019;38(3):359–67. https://doi.org/10.1377/hlthaff.2018.05067.
We are grateful for Elizabeth A. McGuier, R. Kathryn McHugh, Katherine E. Phillips, Colleen A. Maxwell, Elan N. French, Lesley A. Norris, Hannah E. Frank, Lauren B. Alloy, and Richard G. Heimberg for their input on the conceptualization of this idea, as well as the writing of the grant that funds this work. Special thanks also to Jacob M. Blank for coming up with the Project CHAT acronym.
This project was funded by a National Institute of Mental Health (NIMH) research grant awarded to MEC (F31MH123038). This work also was supported by the Temple University Shipley Research Prize and the University of California San Diego Dissemination and Implementation Science Center Dissemination and Implementation Training, Conference, and Publication Award. Manuscript preparation was supported by National Institutes of Health grant P50MH113662 (JP). MSA is supported by the National Center for Advancing Translational Sciences, National Institutes of Health grant UL1TR002003. Funders have no role in the study design or analyses.
Ethics approval and consent to participate
The Temple University Institutional Review Board has approved this study (Protocol Number: 26871). Participants will provide informed consent prior to participating in the study.
Consent for publication
PCK receives royalties from the sales of published materials related to the treatment of youth, and his spouse operates and receives income from the publisher.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Crane, M.E., Atkins, M.S., Becker, S.J. et al. The effect of caregiver key opinion leaders on increasing caregiver demand for evidence-based practices to treat youth anxiety: protocol for a randomized control trial. Implement Sci Commun 2, 107 (2021). https://doi.org/10.1186/s43058-021-00213-x
- Key opinion leader
- Theory of planned behavior
- Direct-to-consumer marketing
- Healthcare utilization
- Evidence-based practice
- Youth anxiety