Table 2 Mapping of study measures onto implementation outcomes

Quantitative data measures

Training evaluations, year 1 and 2 survey items

• The content increased my knowledge of the topic

• The presenter was knowledgeable about the content

• The presenter communicated information in a way that was easy to understand

• The presenter was comfortable answering questions

• The time allowed was enough to cover the content

• I would recommend this event/activity to my colleagues

• My overall rating of today’s session is favorable

Training evaluations, year 1 and 2 survey items

• The content is applicable to my work

• I need more explanation on the topics covered today

• I need more support to implement this information

Mid-year surveys, year 1 (training + RS3 only)

• Survey items with the stem, “Were the following strategies helpful?”

• Survey items with the stem, “Has the [support component] helped you do the following?

Web site usage data, years 1 and 2 (training + RS3 only)

• Number of individual users that logged in to web portal

• Number of times each user logged in to web portal

Web site usage data, years 1 and 2

(training + RS3 only)

• Number of individual users that logged in to web portal

• Number of times each user logged in to web portal

Qualitative data measures

See below

See below

Interview prompts (training + RS3 only)

• Year 1: What were the challenges to using [support component]?

• Year 2: Did you have any barriers to attending the virtual learning sessions?

The following qualitative sources yielded themes that fell within various constructs:

Interview prompts (training + RS3 group only)

• Year 1: How do you feel like the assistance from [the ISP] went? [follow-up prompt] did you have a preference for in-person vs. virtual assistance?

• Year 1: How do you feel like the virtual learning sessions went?

• Year 1: Were there any other supports that were particularly helpful?

• Year 2: How has the virtual support from the ISP impacted your efforts to implement PBIS this year?

• Year 2: How have the virtual learning sessions impacted your efforts to implement PBIS this year?

Implementation support practitioner reflections, year 1

Training Evaluations, year 2 write-in response prompts

• Compared to in-person training, what were the pros of completing an online training?

• Compared to in-person training, what were the cons of completing an online training?