Initial validation of a self-report questionnaire based on the Theoretical Domains Framework: determinants of clinician adoption of a novel colorectal cancer screening strategy
Implementation Science Communications volume 2, Article number: 119 (2021)
Colorectal cancer (CRC) screening for average risk adults age 45 and older continues to be underutilized in the USA. One factor consistently associated with CRC screening completion is clinician recommendation. Understanding the barriers and facilitators of clinical adoption of emerging CRC screening strategies is important in developing effective intervention strategies to improve CRC screening rates. We aimed to develop a questionnaire based on the Theoretical Domains Framework (TDF) to assess determinants of clinical adoption of novel CRC screening strategies, using the multi-target stool DNA test (mt-sDNA; Cologuard®) as an example, and test the psychometric properties of this questionnaire on a sample of US clinicians.
A web survey was administered between November and December 2019 to a national panel of clinicians including primary care clinicians (PCCs) and gastroenterologists (GIs) to assess 10 TDF constructs with 55 items. Confirmatory factor analysis (CFA) was used to examine whether the a priori domain structure was supported by the data. Discriminant validity of domains was tested with Heterotrait-Monotrait ratio (HTMT). Internal consistency for each scale was assessed using Cronbach’s alpha. Criterion validity was assessed with self-reported mt-sDNA use and mt-sDNA recommendation as the outcomes.
Complete surveys were received from 814 PCCs and 159 GIs (completion rate, 24.7% of 3299 PCCs and 29.6% of 538 GIs). Providers were excluded from analysis if they indicated not recommending CRC screening to average-risk patients (final N = 973). The final questionnaire consisted of 38 items covering 5 domains: (1) knowledge; (2) skills; (3) identity and social influence; (4) optimism, beliefs about consequences, and intentions; and (5) environmental context and resources. CFA results confirmed a reasonable fit (CFI = 0.948, SRMR = 0.057, RMSEA = 0.080). The domains showed sufficient discriminant validity (HTMT < 0.85), good internal consistency (McDonald’s omega > 0.76), and successfully differentiated providers who reported they had ordered mt-sDNA from those who never ordered mt-sDNA and differentiated providers who reported routinely recommending mt-sDNA from those who reported not recommending mt-sDNA.
Findings provide initial evidence for the validity and internal consistency of this TDF-based questionnaire in measuring potential determinants of mt-sDNA adoption for average-risk CRC screening. Further investigation of validity and reliability is needed when adapting this questionnaire to other novel CRC screening strategy contexts.
Colorectal cancer (CRC) is the second leading cause of cancer-related deaths in the USA among women and men combined [1, 2]. Major guideline organizations recommend CRC screening among average-risk adults age 45–75 or 50–75 and recommend multiple stool-based and visualization-based screening options [3,4,5]. However, CRC screening continues to be underutilized in the USA, with nearly one third of eligible adults reportedly not up-to-date . One factor consistently associated with higher CRC screening rates is clinician recommendation [7,8,9]. Given the availability of multiple screening strategies that differ in attributes such as safety, efficacy, cost, and the availability of patient navigation, clinicians are increasingly encouraged to engage patients in shared decision-making to select a strategy that is consonant with patient needs and preferences [3, 10,11,12,13,14]. As new CRC screening strategies emerge, understanding how various factors shape clinicians’ adoption of screening strategies is important in developing effective intervention strategies to improve CRC screening rates.
Behavior change theories are particularly useful for guiding the examination of factors shaping clinician behaviors regarding CRC screening because they offer hypotheses about the conditions under which (when) and the mechanisms through which (why) behavior change happens. Understanding when and why behavior change happens can inform the design of implementation strategies to optimize conditions for behavior change and inform the evaluation of implementation processes and outcomes. Theoretical domains framework (TDF)  is an integrated theoretical framework that synthesized 33 behavior theories into 14 construct domains that influence behavior change in the implementation context [15,16,17]. TDF has been used to identify determinants of behavior change, select behavior change techniques, design intervention strategies, and evaluate the implementation process across a wide range of clinical contexts and behaviors [15,16,17,18,19,20,21,22,23,24].
To our knowledge, a questionnaire examining determinants of clinician adoption of emerging CRC screening strategies has not been documented in the literature. Having a comprehensive, valid instrument to reliably assess theoretically grounded factors that shape clinician behaviors surrounding CRC screening could aid in identifying determinants of successful implementation of novel CRC screening strategies and inform organizational and provider-level interventions to improve CRC screening rates. Therefore, we aimed (1) to develop a TDF-based questionnaire to assess determinants of clinician adoption of novel CRC screening strategies using the multi-target stool DNA test (mt-sDNA; Cologuard®, a stool-based CRC screening option for average-risk adults age 45 and older) as an example, and (2) to test the psychometric properties of this questionnaire on a sample of US clinicians. We address four specific research questions: (1) Do the data support the pre-defined TDF-based structure of the items (i.e., construct validity)? (2) To what extent are the domains distinct from each other (i.e., discriminant validity)? (3) How well do items intended to measure the same domain actually measure the same domain (i.e., internal consistency)? And (4) how well do the domains differentiate clinicians who have used (or routinely recommended) mt-sDNA and those who have not used (or routinely recommended) mt-sDNA (i.e., criterion validity)?
We developed a 55-item questionnaire based on Huijg et al. [25, 26] to assess the following 10 TDF domains: knowledge; skills; professional role and identity; social influences; beliefs about capabilities; intentions; optimism; beliefs about consequences; memory, attention, and decision processes; and environmental context and resources. We excluded 3 domains (goals, reinforcement, behavioral regulation) based on published research showing that these items lacked discriminant validity [25, 26]. We also excluded the emotion domain because it is less relevant to our context. We modified Huijg et al. [25, 26] items and included additional items to fit the Cologuard use context. Additional file 1: Appendix summarizes the items and their TDF domain assignment. All items were measured on a 5-point Likert scale (1 = strongly disagree to 5 = strongly agree). We referred to mt-sDNA as Cologuard®, as it is the only mt-sDNA test currently approved by the FDA for clinical application. Additional measures including whether the provider had ever ordered mt-sDNA for a patient (mt-sDNA use) and whether the provider routinely recommended mt-sDNA for CRC screening to average-risk patients (mt-sDNA recommendation) [27,28,29]. Pretest interviews were conducted with 11 clinicians from the survey panel to validate the survey length, survey programming, and data collection methodology prior to administering the survey.
Data were collected through a web survey between November and December 2019 by AmeriSpeak®, a research panel developed and funded by NORC at the University of Chicago (http://www.norc.org) using a third-party vendor, Dynata, who maintains a validated panel of over 200,000 US clinicians. Among 3299 primary care clinicians (PCCs) and 538 gastroenterologists (GIs) who were invited, 993 clinicians (26%) completed the survey. Providers who indicated specializations other than internal medicine, family medicine, or gastroenterology (e.g., pediatrics, cardiology; N = 20) or indicated not recommending CRC screening to average-risk patients (N = 5) were excluded, resulting in a final sample of 814 PCCs (24.7%) and 159 GIs (29.6%) (Fig. 1). Participants received remunerations based on fair market value hourly rate ($39 for PCCs and $51 for GIs).
To examine whether the a priori assignment of the items based on TDF is supported by the data, we used confirmatory factor analysis (CFA) with robust weighted least squares estimation (WLSMV), a method suitable for ordinal data [30,31,32]. Model fit was assessed using multiple criteria based on recommendations in the literature [33,34,35].
To reduce the risk of capitalization on chance, we split the full sample randomly into two subsamples of equal size . We used subsample 1 to generate and refine the model and we used subsample 2 to validate the resulting model. Because the fit of the initial 10-domain model was poor, we switched to an exploratory approach. We first examined the polychoric correlation matrix of the items for values exceeding .85 which would suggest one of the two corresponding items is redundant. We then conducted parallel analysis to identify the number of major factors in the data and used hierarchical agglomerative cluster analysis to examine item clusters [37,38,39]. Redundant items and items that did not map onto the intended domains were removed. We re-specified a CFA model based on the exploratory analyses and tested it with subsample 1. To improve model fit, we examined the residual covariance matrix to identify areas that are not well-explained by the model, then correlated the error terms of items that are conceptually related or similar in question wording to account for the method effect. This step was done iteratively; we examined model fit after each adjustment and stopped adjustment once acceptable fit was achieved. The final model was then tested with subsample 2.
Discriminant validity of the domains was assessed using heterotrait-monotrait ratio of correlations (HTMT), with a value < 0.85 considered satisfactory [40, 41]. The internal consistency of each domain scale was assessed using McDonald’s omega .
After a theoretically meaningful and statistically acceptable factor model was achieved, we derived domain scores for each provider by generating factor scores (i.e., estimated values for the latent variables) from the final CFA model and rescaling them to have a 1–5 range to facilitate interpretation. To assess criterion validity, we examined whether the domains can predict mt-sDNA use (i.e., whether the provider had ever ordered mt-sDNA) and mt-sDNA recommendation (i.e., whether the provider routinely recommended mt-sDNA for CRC screening) using logistic regression. Additionally, we conducted two multivariate analysis of variance (MANOVA) with the domain scores as the outcomes and mt-sDNA use and mt-sDNA recommendation as the independent variable in each model to understand how providers’ domain scores differ by mt-sDNA use and mt-sDNA recommendation.
Sample characteristics were reported in Table 1. Among PCCs, 77% had ever ordered mt-sDNA for a patient, compared to 78% of GIs. A minority of PCCs (23%) and GIs (22%) indicated that they do not routinely recommend mt-sDNA for average-risk CRC screening. For cross-validation purposes, we split the full sample randomly into exploratory subsample 1 (N = 486) and confirmatory subsample 2 (N = 487). The two subsamples did not differ on provider characteristics.
Analysis on exploratory subsample 1
CFA results of the initial 10-domain model showed poor fit (Table 2), suggesting significant discrepancies between the observed data and the theorized model. We removed 9 redundant items after examining the correlation matrix and removed 1 item that measures the behavior outcome of mt-sDNA use rather than its antecedent. The parallel analysis and scree plot showed that the data may have 5 major factors (Fig. 2). The cluster analysis (Fig. 3) showed that the 1st factor consists mostly of items about skills and perceived ease of Cologuard use. The 2nd factor consists of items about professional role and social influence, the 3rd factor mostly consists of items about optimism, positive consequences, and intentions regarding mt-sDNA use, representing the reflective and evaluative processes that motivate the performance of a behavior . The 4th factor mostly contains items about environmental context and resources regarding mt-sDNA use and CRC screening. The 5th factor contains mostly items about knowledge regarding Cologuard use and CRC screening. Seven items were removed because they did not cluster with other items of their intended domains. Reasons for item removal were summarized in Additional file 1: Appendix.
We re-specified a 5-factor CFA model using the remaining 38 items and achieved acceptable fit after allowing the error terms of 12 pairs of items to correlate because they are conceptually related or similar in question wording: χ2(607) = 2358.83, p < .001, CFI = 0.958, SRMR = 0.057, RMSEA = 0.077 (90% CI, 0.074–0.080) (Table 2). All pairs of domains satisfied the criterion for establishing discriminant validity (Table 3) and all domains demonstrated good internal consistency (Table 4).
Analysis on confirmatory subsample 2
The 5-factor model was confirmed using subsample 2. The fit indexes suggested an acceptable fit between the data and the model, χ2(607) = 2396.75, p < .001, CFI = 0.944, SRMR = 0.065, RMSEA = 0.078 (90% CI, 0.075–0.081) (Table 3). All pairs of domains achieved discriminant validity (Table 4) and all domains demonstrated internal consistency (Table 4).
Analysis showed that “Knowledge,” “Optimism, beliefs about consequences, and intentions,” and “Environmental context and resources” were positively associated with mt-sDNA use and mt-sDNA recommendation. Providers with higher scores on these domains were more likely to report having ordered mt-sDNA for a patient (Use: OR = 10.59, 95% CI = 4.49–25.89; OR = 1.89, 95% CI = 1.11–3.23; OR = 2.94, 95% CI = 1.10–7.95; Recommendation: OR = 4.14, 95% CI = 1.86–9.41; OR = 4.05, 95% CI = 2.45–6.76; OR = 2.94, 95% CI = 1.17–7.43) (Table 5). Given the high correlations between the domains (r ranges from .535 to .848), the reason the associations between the behavior outcomes and “Skills” and “Professional role and social influence” were not statistically significant could be due to a multicollinearity issue rather than that these domains had little influence on the outcomes.
To understand how providers who reported mt-sDNA use differ from those who did not report mt-sDNA use on each theoretical domain, we compared their mean scores of each domain using a 5x2 MANOVA. The result showed a large difference across the five domains (F(5, 967) = 83.60, p < .001, Pillai’s trace = 0.302, partial η2 = .302). Providers who reported mt-sDNA use scored statistically significantly higher on each domain compared to providers who reported no mt-sDNA use (“Knowledge”: F(1, 971) = 396.13, p < .001, η2 = .290; “Skills”: F(1, 971) = 346.15, p < .001, η2 = .263; “Professional role and social influence”: F(1, 971) = 195.54, p < .001, η2 = .168; “Optimism, beliefs about consequences, and intentions”: F(1, 971) = 212.74, p < .001, η2 = .180) ; “Environmental context and resources”: F(1, 971) = 184.94, p < .001, η2 = .160).
Another 5x2 MANOVA was conducted to understand how providers who reported routinely recommending mt-sDNA versus not recommending mt-sDNA differ on each domain. The results showed a large difference across the five domains (F(5, 967) = 49.50, p < .001, Pillai’s trace = 0.204, partial η2 = .204). Providers who reported mt-sDNA use scored statistically significantly higher on each domain compared to providers who reported no mt-sDNA use (“Knowledge”: F(1, 971) = 180.12, p < .001, η2 = .156; “Skills”: F(1, 971) = 203.03, p < .001, η2 = .173; “Professional role and social influence”: F(1, 971) = 158.24, p < .001, η2 = .140; “Optimism, beliefs about consequences, and intentions”: F(1, 971) = 212.25, p < .001, η2 = .179); “Environmental context and resources”: F(1, 971) = 140.28, p < .001, η2 = .126). Table 5 and Fig. 4 summarizes mean differences in each domain by mt-sDNA use and recommendation.
We developed and tested a TDF-informed questionnaire examining determinants of clinician adoption of novel CRC screening methods using the mt-sDNA test as an example. Our analyses showed that the 10 TDF domains can be described by 5 domains with reasonable to good construct validity, discriminant validity, and internal consistency. The 5 domains include (1) knowledge; (2) skills; (3) identity and social influence; (4) optimism, beliefs about consequences, and intentions; and (5) environmental context and resources. Additionally, the domains demonstrated criterion validity for provider mt-sDNA use and mt-sDNA recommendation. Each subscale successfully differentiated between providers who reported had ordered mt-sDNA for their patients versus providers who had not ordered mt-sDNA and differentiated between providers who reported routinely recommending mt-sDNA for CRC screening versus providers who reported not recommending mt-sDNA. The differences in mean domain scores by mt-sDNA use and recommendation were large .
For mt-sDNA use, the “Knowledge” and “Skills” domains showed the largest differences and the “Environmental context and resources” domain showed the smallest difference. Providers who had not ordered mt-sDNA scored, on average, below the scale midpoint (Fig. 4). These findings suggest that there are large rooms for improvement in all 5 domains for our providers who have not used mt-sDNA and intervention strategies targeting the “Knowledge” and “Skills” domains may lead to the largest increase in mt-sDNA use. To develop appropriate intervention strategies to address the target domains, we can start by mapping the domains to the components of the Capability, Opportunity, and Motivation Model of Behaviour (COM-B) and selecting the intervention functions from its accompanying Behavior Change Wheel . In our example, the “Knowledge” and “Skills” domains map onto the “Capacity” component of COM-B and the appropriate intervention functions may include “education,” “training,” and “enablement.” Once potential intervention functions are identified, we can refer to the Behavior Change Technique Taxonomy  to select the specific techniques that have been shown to serve the particular intervention functions in previous research and are appropriate for the specific clinical behavior and practice context.
It is worth noting that we developed the questionnaire based on a 10-domain structure while the results showed that a 5-domain structure was more appropriate for our data. The TDF domains “Intentions,” “Optimism,” and “Beliefs about consequences” failed to establish discriminant validity due to high correlations between items across domains. We also combined “Knowledge” and “Beliefs about capabilities” into one domain for the same reason. Previous research has observed similar high correlations across TDF domains in other clinical contexts [21, 46, 47], suggesting the domains are not each describing a unique aspect of a behavior. If the goal is to identify TDF domains that are most influential for behavior change in a given context, high correlations between domains may limit researchers’ ability to take a multivariate approach to examine the associations between the domains and the behavior outcome.
To our knowledge, this is the first questionnaire aimed to assess theoretically grounded determinants of clinician adoption of novel CRC screening strategies. Data collected through this questionnaire can be used to ascertain barriers and facilitators to clinician adoption of novel CRC screening tests, such as mt-sDNA, and to help identify appropriate implementation strategies . It should be noted that a TDF-informed questionnaire can aid in identifying determinants of a specific implementation behavior in a given context, but it does not provide directions on how to bring about behavior change as TDF does not specify the causal relationships between domains. Therefore, researchers need to consult additional behavior change theories [43, 49, 50] relevant to the selected domains to identify the mechanisms through which behavior change occur and choose intervention strategies accordingly.
First, due to the small sample size of GIs, we were unable to examine whether the questionnaire’s psychometric properties differ between PCCs and GIs. Second, we used self-reported behaviors to test criterion validity. Future research is encouraged to use objective measures of provider behaviors. Third, the five domains of this questionnaire were highly correlated in our data. Future research could consider refining the items with less similar wording across items to reduce method effect. Fourth, five TDF domains were not covered in the final questionnaire, including Behavioral regulation, Emotion, Goals, Memory, attention and decision processes, and Reinforcement. Future research should consider developing and validating new items measuring these domains. Finally, although consistent with declining and generally lower response rates of clinician surveys, our modest completion rate may introduce selection bias [51,52,53]. Future research should examine if the questionnaire shows similar psychometric properties in their target population.
Using a national sample of clinicians, we conducted initial validation of a TDF-informed questionnaire assessing determinants of clinician adoption of novel CRC screening strategies using mt-sDNA as an example. Our evaluation showed that this questionnaire covers 5 domains with reasonable validity and good internal consistency. Future research should be undertaken to ascertain this instrument’s validity and reliability among GIs, its ability in predicting actual provider behaviors, and its generalizability to other CRC screening strategy contexts. Nonetheless, our findings suggest that data collected through this questionnaire can be useful for identifying barriers and facilitators to adoption of mt-sDNA in clinical practice and informing the selection of appropriate implementation strategies.
Availability of data and materials
The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.
Multi-target stool DNA
Theoretical domains framework
Primary care clinicians
Confirmatory factor analysis
Weighted least squares estimation
Standardized root mean square residual
Root mean square error of approximation
Comparative fit index
Multivariate analysis of variance
Analysis of variance
Cronin KA, Lake AJ, Scott S, Sherman RL, Noone AM, Howlader N, et al. Annual report to the nation on the status of cancer, part I: national cancer statistics. Cancer. 2018;124(13):2785–800. https://doi.org/10.1002/cncr.31551.
Siegel RL, Miller KD, Fuchs HE, Jemal A. Cancer statistics, 2021. CA Cancer J Clin. 2021;71(1):7–33. https://doi.org/10.3322/caac.21654.
U. S. Preventive Services Task Force, Bibbins-Domingo K, Grossman DC, Curry SJ, Davidson KW, Epling JW Jr, et al. Screening for colorectal cancer: US preventive services task force recommendation statement. JAMA. 2016;315(23):2564–75. https://doi.org/10.1001/jama.2016.5989.
Wolf AMD, Fontham ETH, Church TR, Flowers CR, Guerra CE, LaMonte SJ, et al. Colorectal cancer screening for average-risk adults: 2018 guideline update from the American Cancer. Society. 2018;68(4):250–81. https://doi.org/10.3322/caac.21457.
Rex DK, Boland CR, Dominitz JA, Giardiello FM, Johnson DA, Kaltenbach T, et al. Colorectal cancer screening: recommendations for physicians and patients from the U.S. Multi-Society Task Force on Colorectal Cancer. Gastroenterology. 2017;153(1):307–23. https://doi.org/10.1053/j.gastro.2017.05.013.
Klabunde CN, Joseph DA, King JB, White A, Plescia M. Vital signs: colorectal cancer screening test use - United States, 2012. Mmwr-Morbid Mortal W. 2013;62(44):881–8.
Vernon SW. Participation in colorectal cancer screening: a review. J Natl Cancer Inst. 1997;89(19):1406–22. https://doi.org/10.1093/jnci/89.19.1406.
Cokkinides VE, Chao A, Smith RA, Vernon SW, Thun MJ. Correlates of underutilization of colorectal cancer screening among U.S. adults, age 50 years and older. Prev Med. 2003;36(1):85–91. https://doi.org/10.1006/pmed.2002.1127.
Zapka JG, Puleo E, Vickers-Lahti M, Luckmann R. Healthcare system factors and colorectal cancer screening. Am J Prev Med. 2002;23(1):28–35. https://doi.org/10.1016/S0749-3797(02)00444-0.
Kistler CE, Hess TM, Howard K, Pignone MP, Crutchfield TM, Hawley ST, et al. Older adults' preferences for colorectal cancer-screening test attributes and test choice. Patient Prefer Adherence. 2015;9:1005–16. https://doi.org/10.2147/PPA.S82203.
Hawley ST, McQueen A, Bartholomew LK, Greisinger AJ, Coan SP, Myers R, et al. Preferences for colorectal cancer screening tests and screening test use in a large multispecialty primary care practice. Cancer. 2012;118(10):2726–34. https://doi.org/10.1002/cncr.26551.
Singal AG, Gupta S, Skinner CS, Ahn C, Santini NO, Agrawal D, et al. Effect of colonoscopy outreach vs fecal immunochemical test outreach on colorectal cancer screening completion: a randomized clinical trial. JAMA. 2017;318(9):806–15. https://doi.org/10.1001/jama.2017.11389.
Liang PS, Wheat CL, Abhat A, Brenner AT, Fagerlin A, Hayward RA, Thomas JP, Vijan S, Inadomi JM Adherence to competing strategies for colorectal cancer screening over 3 years. Am J Gastroenterol 2016;111(1):105-114, 1, DOI: https://doi.org/10.1038/ajg.2015.367.
Inadomi JMMD, Vijan SMDMS, Janz NKP, Fagerlin AP, Thomas JPBS, Lin YVRNMA, et al. Adherence to colorectal cancer screening: a randomized clinical trial of competing strategies. Arch Intern Med. 2012;172(7):575–82. https://doi.org/10.1001/archinternmed.2012.332.
Michie S, Johnston M, Abraham C, Lawton R, Parker D, Walker A. Making psychological theory useful for implementing evidence based practice: a consensus approach. Qual Saf Health Care. 2005;14(1):26–33. https://doi.org/10.1136/qshc.2004.011155.
Cane J, O’Connor D, Michie S. Validation of the theoretical domains framework for use in behaviour change and implementation research. Implement Sci. 2012;7(1):37. https://doi.org/10.1186/1748-5908-7-37.
Atkins L, Francis J, Islam R, O’Connor D, Patey A, Ivers N, et al. A guide to using the Theoretical Domains Framework of behaviour change to investigate implementation problems. Implement Sci. 2017;12(1):77. https://doi.org/10.1186/s13012-017-0605-9.
Patey AM, Islam R, Francis JJ, Bryson GL, Grimshaw JM, the Canada PPT. Anesthesiologists’ and surgeons’ perceptions about routine pre-operative testing in low-risk patients: application of the Theoretical Domains Framework (TDF) to identify factors that influence physicians’ decisions to order pre-operative tests. Implement Sci. 2012;7(1):52.
LA MS, Dombrowski SU, Francis JJ, Murphy J, Martin CM, O’Leary JJ, et al. ‘It’s a can of worms’: understanding primary care practitioners’ behaviours in relation to HPV using the theoretical domains framework. Implementation. Science. 2012;7(1):73.
Duncan EM, Francis JJ, Johnston M, Davey P, Maxwell S, McKay GA, McLay J, Ross S, Ryan C, Webb DJ, Bond C, PROTECT Study Group. Learning curves, taking instructions, and patient safety: using a theoretical domains framework in an interview study to investigate prescribing errors among trainee doctors. Implement Sci 2012;7(1):86, DOI: https://doi.org/10.1186/1748-5908-7-86.
Amemori M, Michie S, Korhonen T, Murtomaa H, Kinnunen TH. Assessing implementation difficulties in tobacco use prevention and cessation counselling among dental providers. Implement Sci. 2011;6(1):50. https://doi.org/10.1186/1748-5908-6-50.
Taylor N, Parveen S, Robins V, Slater B, Lawton R. Development and initial validation of the influences on patient safety behaviours questionnaire. Implement Sci. 2013;8(1):81. https://doi.org/10.1186/1748-5908-8-81.
Rosário F, Vasiljevic M, Pas L, Fitzgerald N, Ribeiro C. Implementing alcohol screening and brief interventions in primary health care: study protocol for a pilot cluster randomized controlled trial. Fam Pract. 2019;36(2):199–205. https://doi.org/10.1093/fampra/cmy062.
Abidi L, Oenema A, Candel MJJM, van de Mheen D. A theory-based implementation program for alcohol screening and brief intervention (ASBI) in general practices: planned development and study protocol of a cluster randomised controlled trial. Contemp Clin Trials. 2016;51:78–87. https://doi.org/10.1016/j.cct.2016.10.008.
Michie S, Johnston M, Francis J, Hardeman W, Eccles M. From theory to intervention: mapping theoretically derived behavioural determinants to behaviour change techniques. Appl Psychol. 2008;57(4):660–80. https://doi.org/10.1111/j.1464-0597.2008.00341.x.
Huijg JM, Gebhardt WA, Crone MR, Dusseldorp E, Presseau J. Discriminant content validity of a theoretical domains framework questionnaire for use in implementation research. Implement Sci. 2014;9(1):11. https://doi.org/10.1186/1748-5908-9-11.
Meissner HI, Klabunde CN, Breen N, Zapka JM. Breast and colorectal cancer screening: U.S. primary care physicians' reports of barriers. Am J Prev Med. 2012;43(6):584–9. https://doi.org/10.1016/j.amepre.2012.08.016.
Klabunde CN, Vernon SW, Nadel MR, Breen N, Seeff LC, Brown ML. Barriers to colorectal cancer screening: a comparison of reports from primary care physicians and average-risk adults. Med Care. 2005;43(9):939–44. https://doi.org/10.1097/01.mlr.0000173599.67470.ba.
Klabunde CN, Frame PS, Meadow A, Jones E, Nadel M, Vernon SW. A national survey of primary care physicians' colorectal cancer screening recommendations and practices. Prev Med. 2003;36(3):352–62. https://doi.org/10.1016/S0091-7435(02)00066-X.
Rhemtulla M, Brosseau-Liard PÉ, Savalei V. When can categorical variables be treated as continuous? A comparison of robust continuous and categorical SEM estimation methods under suboptimal conditions. Psychol Methods. 2012;17(3):354–73. https://doi.org/10.1037/a0029315.
Bandalos DL. Relative performance of categorical diagonally weighted least squares and robust maximum likelihood estimation. Struct Equ Model Multidiscip J. 2014;21(1):102–16. https://doi.org/10.1080/10705511.2014.859510.
Li C-H. Confirmatory factor analysis with ordinal data: comparing robust maximum likelihood and diagonally weighted least squares. Behav Res Methods. 2016;48(3):936–49. https://doi.org/10.3758/s13428-015-0619-7.
Hu L, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Model Multidiscip J. 1999;6(1):1–55. https://doi.org/10.1080/10705519909540118.
Browne MW, Cudeck R. Alternative ways of assessing model fit. Soc Method Res. 1992;21(2):230–58. https://doi.org/10.1177/0049124192021002005.
Kline RB. Principles and practice of structural equation modeling. 4rth ed. New York: The Guilford Press; 2016. xvii, 534.
MacCallum RC, Roznowski M, Necowitz LB. Model modifications in covariance structure analysis: the problem of capitalization on chance. Psychol Bull. 1992;111(3):490–504. https://doi.org/10.1037/0033-2909.111.3.490.
Cattell RB. The Scree test for the number of factors. Multivar Behav Res. 1966;1(2):245–76. https://doi.org/10.1207/s15327906mbr0102_10.
Horn JL. A rationale and test for the number of factors in factor analysis. Psychometrika. 1965;30(2):179–85. https://doi.org/10.1007/BF02289447.
Nielsen F. Hierarchical Clustering. In: Nielsen F, editor. Introduction to HPC with MPI for data science. Cham: Springer International Publishing; 2016. p. 195–211. https://doi.org/10.1007/978-3-319-21903-5_8.
Henseler J, Ringle CM, Sarstedt M. A new criterion for assessing discriminant validity in variance-based structural equation modeling. J Acad Market Sci. 2015;43(1):115–35. https://doi.org/10.1007/s11747-014-0403-8.
Voorhees CM, Brady MK, Calantone R, Ramirez E. Discriminant validity testing in marketing: an analysis, causes for concern, and proposed remedies. J Acad Market Sci. 2016;44(1):119–34. https://doi.org/10.1007/s11747-015-0455-4.
Dunn TJ, Baguley T, Brunsden V. From alpha to omega: a practical solution to the pervasive problem of internal consistency estimation. Br J Psychol. 2014;105(3):399–412. https://doi.org/10.1111/bjop.12046.
Michie S, van Stralen MM, West R. The behaviour change wheel: a new method for characterising and designing behaviour change interventions. Implement Sci. 2011;6(1):42. https://doi.org/10.1186/1748-5908-6-42.
Cohen J. A power primer. Psychol Bull. 1992;112(1):155–9. https://doi.org/10.1037/0033-2909.112.1.155.
Michie S, Richardson M, Johnston M, Abraham C, Francis J, Hardeman W, et al. The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behavior change interventions. Ann Behav Med. 2013;46(1):81–95. https://doi.org/10.1007/s12160-013-9486-6.
Huijg JM, Gebhardt WA, Dusseldorp E, Verheijden MW, van der Zouwe N, Middelkoop BJC, et al. Measuring determinants of implementation behavior: psychometric properties of a questionnaire based on the theoretical domains framework. Implement Sci. 2014;9(1):33. https://doi.org/10.1186/1748-5908-9-33.
Beenstock J, Sniehotta FF, White M, Bell R, Milne EMG, Araujo-Soares V. What helps and hinders midwives in engaging with pregnant women about stopping smoking? A cross-sectional survey of perceived implementation difficulties among midwives in the North East of England. Implement Sci. 2012;7(1):36. https://doi.org/10.1186/1748-5908-7-36.
French SD, Green SE, O’Connor DA, McKenzie JE, Francis JJ, Michie S, et al. Developing theory-informed behaviour change interventions to implement evidence into practice: a systematic approach using the Theoretical Domains Framework. Implement Sci. 2012;7(1):38. https://doi.org/10.1186/1748-5908-7-38.
Fishbein M, Ajzen I. Predicting and changing behavior: the reasoned action approach. New York: Psychology Press; 2010. xix, 518-xix.
Johnston M, Carey RN, Connell Bohlen LE, Johnston DW, Rothman AJ, de Bruin M, et al. Development of an online tool for linking behavior change techniques and mechanisms of action based on triangulation of findings from literature synthesis and expert consensus. Transl Behav Med. 2021;11(5):1049–65. https://doi.org/10.1093/tbm/ibaa050.
Asch DA, Jedrziewski MK, Christakis NA. Response rates to mail surveys published in medical journals. J Clin Epidemiol. 1997;50(10):1129–36. https://doi.org/10.1016/S0895-4356(97)00126-1.
Asch S, Connor SE, Hamilton EG, Fox SA. Problems in recruiting community-based physicians for health services research. J Gen Intern Med. 2000;15(8):591–9. https://doi.org/10.1046/j.1525-1497.2000.02329.x.
McLeod CC, Klabunde CN, Willis GB, Stark D. Health care provider surveys in the United States, 2000-2010: a review. Eval Health Prof. 2013;36(1):106–26. https://doi.org/10.1177/0163278712474001.
Writing and administrative support were provided by William K. Johnson, PhD, MSc, an employee of Exact Sciences Corporation.
Exact Sciences Corporation funded this study. The funding agreement ensured author independence when developing the survey questions, interpreting and analyzing the data, and writing and submitting the publication.
Ethics approval and consent to participate
Each listed author contributed significantly to the manuscript and all have complied with the Committee on Publication Ethics (COPE) guidelines on ethical responsibilities of authors. This study was exempt from review by NORC Institutional Review Board (IRB). NORC worked with a third-party vendor, Dynata, to collect these data from Dynata’s panel of healthcare providers in the USA. Survey responses were anonymous. The authors had no access to identifiable information of the participants.
Consent for publication
EW is an employee of Exact Sciences Corporation. PJL serves as Chief Medical Officer for Screening at Exact Sciences through a contracted services agreement with Mayo Clinic. PJL and Mayo Clinic have contractual rights to receive royalties through this agreement. LJFR and JMG offer scientific input to research studies through a contracted services agreement between Mayo Clinic and Exact Sciences. All other authors (XZ, MKL) report no competing interests. No financial disclosures were reported by the authors of this paper.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Zhu, X., Lee, M.K., Weiser, E. et al. Initial validation of a self-report questionnaire based on the Theoretical Domains Framework: determinants of clinician adoption of a novel colorectal cancer screening strategy. Implement Sci Commun 2, 119 (2021). https://doi.org/10.1186/s43058-021-00221-x
- Colorectal cancer screening
- Theoretical domains framework
- Questionnaire validation