Skip to main content

Table 1 Prioritization of consultation tasks

From: The Cognitive Walkthrough for Implementation Strategies (CWIS): a pragmatic method for assessing implementation strategy usability

Task Importance mean rating Likelihood of error mean rating Prioritization
Access digital materials (obtain internet access, access/navigate modules or message board 5.0 4.0 Selected for testing
Present 1st MBC case (succinctly summarize case features/MBC plan, select assessment instrument OR describe results of initial assessment, describe rationale for ongoing assessments, articulate what a positive response would look like OR describe results of ongoing assessments, describe next steps for MBC with the case) 5.0 4.0 Selected for testing
Articulate possible barriers/concerns with MBC for identified cases (identify barriers, articulate likelihood of each barrier, problem-solve barrier with consultant: generate solutions, select a solution to apply) 4.8 3.5 Selected for testing
Plan for maintenance of behavior change (articulate additional barriers to MBC, problem-solve barriers with consultation group: generate solutions, select a solution to apply) 4.5 4.0 Selected for testing
Login to message board (access user name/password info, type user name/password successfully) 4.5 3.0 Deprioritized (entirely digital process)
Revise planned MBC steps with case based on feedback/discussion (change monitoring target for MBC cases: revisit goals/select alternative targets/articulate plan to present alternative targets to case, select alternative cases for MBC) 4.0 3.3 Selected for testing
Navigate to message board from 1+ location 4.0 3.3 Deprioritized (entirely digital process)
Articulate questions/problems encountered RE: MBC skill application (identify specific MBC step where assistance is needed, respond to consultant questions clarifying details about skill application: what have they tried/what are they trying to achieve/what has been problematic, *role play MBC conversation 4.0 2.5  
2nd or 3rd case presentation (succinctly summarize case features/MBC plan, select assessment instrument OR describe results of initial assessment, describe rationale for ongoing assessments, articulate what a positive response would look like OR describe results of ongoing assessments, describe next steps for MBC with the case) 3.8 3.0  
Navigate to appropriate discussion thread 3.8 3.0  
Read trainee and consultant posts within a thread 3.8 2.8  
Discuss non-completion of practice activity (generate reasons, problem solve: generate solutions, select solution to apply) 3.5 3.3  
Complete values activity (articulate professional values, articulate barriers, articulate if/then plan linking barriers to correction actions) 3.5 3.3  
Post practice activity results 3.3 3.7  
Schedule make-up calls 3.3 3.3  
Identify/post cases to serve as MBC targets (review cases to identify those appropriate for MBC, post succinct case examples on message board) 3.3 2.3  
Give Introduction (wait turn/speak at appropriate time, present info, report practice activity, summarize practice activity) 3.3 2.0  
Record new practice/homework assignment to be posted to message board 3.0 2.8  
Other practice/homework activities 2.8 2.8  
Provide feedback on others’ posts/MBC application questions (identify relevant BOLT map steps) 2.5 3.0  
Email consultants with questions 2.5 2.0  
Revise an existing MBC script to tailor to personal style/student population 2.5 1.8  
Provide constructive feedback to other trainees (wait turn/speak at appropriate time, describe ideas about MBC application) 2.3 2.8  
Document questions/concerns as they arise 1.8 2.3  
  1. MBC measurement-based care