Skip to main content

Table 4 Consultation strategy redesign decisions

From: The Cognitive Walkthrough for Implementation Strategies (CWIS): a pragmatic method for assessing implementation strategy usability

Usability issues Consultation redesign
*Focus on barriers detracts from case presentation
*Unprepared to identify solutions to barriers
*Digressions derail barrier problem solving and engagement
*Case presentations exceed time allotted
*Unfamiliar case update structure
Development of Troubleshooting Guide (guidelines, examples and tips) for consultants
*Focus on barriers detracts from case presentation
*Unprepared to identify solutions to barriers
*Digressions derail barrier problem solving and engagement
*Case presentations exceed time allotted
Clearly defined call agenda, directions and expectations for call activities and participation
*Focus on barriers detracts from case presentation
*Unprepared to identify solutions to barriers
*Digressions derail barrier problem solving and engagement
*Unprepared to articulate updated monitoring targets
*Case presentations exceed time allotted
*Unfamiliar case update structure
*Difficulty articulating what is being measured
Provision of examples (e.g., case presentation) via multiple formats (i.e., modeled in vivo by consultant, discussion board, handouts)
*Focus on barriers detracts from case presentation
*Digressions derail barrier problem solving and engagement
*Case presentations exceed time allotted
*Consultation call duration too brief
Opportunity to ask overflow questions/comments to continue via asynchronous discussion board with both consultant and call group participants
*Focus on barriers detracts from case presentation
*Unprepared to identify solutions to barriers
*Discomfort with assessments in case presentations
Consistent use of affirmation and positive feedback during call discussion, practice activities and discussion board use
*Case presentations exceed time allotted
*Unfamiliar case update structure
*No continued access to resources
*Unaware of available follow-up supports
*Unfamiliar language in consultation model
Development of participant handbook including information on all available resources and how-tos on accessing and utilizing technology (discussion board, training resources, calls), etc.
*Distraction from multi-tasking online during calls
*Technological difficulties are disengaging
Consultant screen-shares appropriate resources, materials or examples during call
*Inadequate on-site technology
*Technological difficulties are disengaging
Research team available to troubleshoot any technological issues or needs during consultation calls
*Inadequate on-site technology
*Distraction from multi-tasking online during calls
*Technological difficulties are disengaging
Additional technical training for consultants (e.g., learning dashboard, zoom videoconference, etc.)
*Unaware of available follow-up supports
*Technological difficulties are disengaging
Orientation for participants on training platform during first call (i.e., discussion board, additional resources)
*Confidentiality concerns when reporting results Promotion of collaborative, safe environment to share via introductions, profile photos and video during calls
*Regular calls incompatible with time/availability
*Duration misaligned with preferences
Participants given one of top choices (rank order) of their preferred time for consultation calls
*Regular calls incompatible with time/availability Offered brief make-up sessions if scheduled group calls were missed (based on their availability)
*Rapid assessment misaligned with available time
*Regular calls incompatible with time/availability
*Duration misaligned with preferences
Reduction of consultation call time from 1–1.5 h to 50 min
*No continued access to resources
*Unaware of available follow-up supports
Allowed continued access to the training modules
*Focus on barriers detracts from case presentation
*No continued access to resources
*Discomfort with assessments in case presentations
*Unaware of available follow-up supports
Development of supplemental MBC resources and reference materials (e.g., workflow tools, standardized assessments repository, MBC tip sheets, etc.)
*Confusion over MBC terminology
*Unfamiliar language in consultation model
Revised language (e.g., reduced jargon, increased readability, clear definitions, etc.) across all project materials
*Unprepared to articulate updated monitoring targets
*Case presentations exceed time allotted
Broke down MBC process into manageable steps (sequence of practice activities followed by feedback) to better align with call timeline