Skip to main content

Table 3 Delphi study with KT experts: results of round 1

From: Improving KT tools and products: development and evaluation of a framework for creating optimized, Knowledge-activated Tools (KaT)

KaT Framework DomainDomain factorNMean (SD)MedianIQR†Percent agreement to include‡
DISCOVERImportant to include the DISCOVER domain in the overall KaT framework356.7 (0.70)7.0097%
It makes sense for the DISCOVER domain to feed into the central part of the KaT framework356.3 (0.94)6.0191%
Knowledge users will find the DISCOVER domain useful.356.1 (1.09)6.0291%
DISCOVER is an appropriate label355.0 (1.40)5.0271%
The 3 sub-domains of DISCOVER (and their elements) make sense336.2 (0.70)6.0194%
The 3 sub-domains of DISCOVER (and their elements) are comprehensive335.9 (1.04)6.0188%
DEVELOPImportant to include in the overall KaT framework356.5 (0.81)7.0186%
Knowledge users will find it useful.355.7 (1.53)6.0274%
The 5 sub-domains of DEVELOP (and their elements) make sense336.2 (0.93)6.0191%
The 5 sub-domains of DEVELOP (and their elements) are comprehensive336.0 (0.88)6.0091%
DISSEMINATEImportant to include in the overall KaT framework356.3 (0.86)7.0194%
Knowledge users will find it useful.355.6 (1.50)6.0371%
The 4 sub-domains (and their elements) make sense336.2 (0.75)6.0191%
The 4 sub-domains (and their elements) are comprehensive336.2 (0.76)6.0194%
IMPLEMENTImportant to include in the overall KaT framework356.5 (0.81)7.0194%
Knowledge users will find it useful356.0 (1.43)7.0283%
The 5 sub-domains (and their elements) make sense326.0 (1.01)6.0191%
The 5 sub-domains (and their elements) are comprehensive326.0 (1.02)6.0091%
3 BROAD DOMAINSThe three domains represented in the KaT framework is comprehensive in terms of capturing what is important to consider in the creation and uptake of KT tools355.54 (1.5)6.0280%
IMPACT DRIVERSThe label “Impact Drivers” appropriately conveys these four concepts355.4 (1.29)6.0180%
The order in which the four impact drivers are represented make sense355.2 (1.63)6.0271%
The placement of the four impact drivers clearly illustrates that they should be considered across each of the three broad domains of the framework (i.e., develop, disseminate, implement)355.4 (1.58)6.0274%
Integrated KT (iKT)
 It makes sense to include iKT as one of the impact drivers356.1 (1.23)6.0191%
 The 3 sub-domains of iKT (and their elements) make sense326.4 (0.72)6.0197%
 The 3 sub-domains of iKT (and their elements) are comprehensive326.3 (0.74)6.0197%
EVALUATION
 It makes sense to include EVALUATION as one of the impact drivers356.1 (1.33)7.0191%
 The representation of EVALUATION across the 3 domainsmake sense325.8 (1.30)6.0288%
 The representation of EVALUATION across the 4 impact driversmake sense325.7 (1.40)6.0288%
 EVALUATION is included in all of the areas of the KaT framework that should consider evaluation316.0 (0.82)6.0297%
SUSTAINABILITY
 It makes sense to include SUSTAINABILITY as one of the impact drivers356.2 (0.83)6.0194%
 The 4 sub-domains (and their elements) of SUSTAINABILITY make sense326.1 (0.70)6.0197%
 The 4 sub-domains (and their elements) of SUSTAINABILITY are comprehensive326.0 (0.88)6.0197%
SCALABILITY
 It makes sense to include SCALABILITY as one of the impact drivers356.2 (0.86)6.0191%
 The 5 sub-domains (and their elements) of SCALABILITY make sense325.7 (1.15)6.0188%
 The 5 sub-domains (and their elements) of SCALABILITY are comprehensive325.9 (1.02)6.0091%
COREThe core is important to include as part of the overall KaT framework356.0 (1.43)6.0183%
The placement of the CORE clearly illustrates that a KT tool is the ultimate goal and end product resulting from using the KaT framework355.7 (1.62)6.0269%
PLANNINGPLANNING, which encircles the core, is important to include as part of the overall KaT framework355.2 (1.61)6.0360%
The placement of PLANNING clearly illustrates that a plan can be generated for each or all of the three broad domains of the KaT framework (i.e., develop, disseminate, implement)354.9 (1.72)5.0354%
ACTION PLANThe ACTION PLAN is important to include as part of the overall KaT framework356.6 (0.77)7.0197%
Researchers will find it useful355.7 (1.33)6.0374%
Health care providers will find it useful355.8 (1.20)6.0377%
Policy or decision makers will find it useful355.7 (1.18)6.0374%
It’s clear that the ACTION PLAN will be an output resulting from the use of the KaT framework356.0 (1.38)6.0191%
The 7 outputs (and their elements) of the ACTION PLAN make sense325.9 (1.12)6.0291%
The 7 outputs (and their elements) of the ACTION PLAN are comprehensive325.9 (1.11)6.0291%
OVERALL KaT frameworkThe overall framework is clear (i.e., easy to understand or interpret)355.3 (1.33)6.0177%
The organization makes sense355.6 (1.34)6.0183%
The KaT framework is a good reflection of its intended purpose (i.e., to guide the rigorous and efficient creation of KT tools)355.7 (1.30)6.0274%
The KaT framework is comprehensive (i.e., it covers the important areas that need to be considered in the creation of KT tools and products)355.9 (1.10)6.0189%
Researchers will find it useful355.8 (1.20)6.0280%
Health care providers will find it useful355.3 (1.40)6.0266%
Policy or decision makers will find it useful355.3 (1.40)6.0263%
TABLE of existing KT toolsKnowledge users will find the TABLE of existing KT tools organized by targets useful355.4 (1.60)6.0363%
Knowledge users will find the TABLE of existing KT tools mapped to purpose categories useful355.4 (1.60)6.0369%
  1. IQR 0 = high consensus, IQR 1 = good consensus, IQR 2 = poor consensus
  2. Percent agreement to include item = score of ≥ 5 out of 7 by ≥ 80% of panel (consensus) or < 5 out of 7 by < 80% of panel (non-consensus)
  3. Domain items that did not reach consensus to include by < 80% of panel are bolded