Skip to main content

Table 3 Study outcomes

From: Group physical therapy for knee osteoarthritis: protocol for a hybrid type III effectiveness-implementation trial

Outcome

Description

Data source

Assessment timepoint(s)

Implementation outcomes (site level)

 Penetration (primary)

Average number of patients enrolling in the EBP monthly

Administrative and VA electronic health record (VA Corporate Data Warehouse)

6 months, 12 months (primary)

 Adoption (dichotomous)

Delivery of Group PT as a clinical service (at least 1 class) and enrollment of at least 5 patients

 Fidelity

Average number of sessions attended by patients who enroll in the EBP

Effectiveness outcomes (patient level)

 30-s chair rise

Number of times patient can stand up from a chair and sit back down within a 30-s period

Collected by clinicians at time of patient visit via electronic or paper survey and stored in the VA electronic health record (VA Corporate Data Warehouse)

Every Group PT class

Note: patient satisfaction and ability to deal with daily problems regarding knee pain are asked after the first class

 Pain experienced during chair rise

Patient-reported pain experienced during chair rise (0–10 numeric scale)

 Patient-reported physical function

PROMIS Short form 4a

 Patient-reported pain interference

PROMIS Short form 4a

 Patient satisfaction

Patient’s response to: “How satisfied are you with the Group PT program?” on a numeric rating scale (0–10)

 Ability to deal with knee pain

Patient’s response to: “Compared to before you before you started the Group PT program, how would you rate your ability to deal with daily problems with knee function and pain now?” on a 5-point Likert (from much worse to much better)

Implementation context and experience

 Program adaptations (using Wiltsey Stirman’s FRAME framework) [47]

Sites report changes to program staffing, delivery, equipment, education, and documentation

Site self-report

Baseline, 6 months, and 12 months

 Qualitative interviews

Implementation process and experience

Key informant semi-structured interviews

Baseline (all sites), 6 months (all sites), and 12 months (sites that receive enhanced support)

 Organizational Readiness for Implementing Change (ORIC) [48]

Used to determine organizational members’ change commitment and efficacy. Each item includes a Likert scale from 1 (disagree) to 5 (agree).

Staff-reported

Baseline

 Organizational resiliencea [49]

Measure of the capacity of an organization to anticipate, prepare for, respond, and adapt to both incremental changes and sudden disruptions to survive and thrive.

Baseline and 12 months

 Challenging and helpful implementation factors

Using a list of items developed through previous work by the Function QUERI team, respondents are asked to select how challenging or helpful resources and other factors (e.g., patient awareness) will be or were when implementing Group PT at their facility on a scale of 1 (not at all) to 5 (very).

Baseline and 12 months

 Implementation Climate Scale (ICS) [50]

Captures six dimensions of the organizational context that indicate to employees the extent to which their organization prioritizes and values the successful implementation of Group PT.

Baseline

 Implementation process and experience

Questions regarding the use of the different Group PT implementation resources and activities. Respondents are asked to indicate, whether their facility used the tool, how much, and how helpful it was for supporting implementation of Group PT.

12 months

 Program Sustainability Indexb [51]

A measure of a program’s capacity for sustainment over time. Using a list of statements related to common program attributes (e.g., leadership competence and staff involvement and integration), respondents are asked to what extent the statements are reflective of their facility on a scale of 0 (not at all) to 4 (to a very great extent).

12 months

 COVID-19 impact question

What impact do you think the COVID-19 pandemic and its effects had on your facility's ability to implement the Group PT program?

Baseline and 12 months

 Enhanced support experiencec

How helpful were the enhanced support sessions with Function QUERI staff? From 1 (not at all helpful) to 5 (very helpful).

12 months

What, if anything, would you change about the enhanced support sessions? [free text response]

 Demographic measures

Questions related to job title, years at the VA, age, gender, etc

Baseline and 12 months

Cost

 Clinical delivery team costs

How much time did each delivery team member spend conducting the following tasks for each Group PT class?

• Time entering data in the EHR

• Time spent with patients on clinical issues outside of class

• Time spent outside of class assisting patients with technical issues

• Other time associated with preparing for delivery of Group PT

Site self-report

After sites host their first Group PT class

 Implementation strategy costs

During the month before Group PT launched, on an average week how much time did each team member spend planning for and/or supporting your Group PT program?

Site self-report

  1. aSubset of measures–items on adaptive capacity rather than the full 13-item short form
  2. bSlight wording change to Q2 and rewording of Likert scale categories (per author’s recommendation)
  3. cSites that receive enhanced support will also be asked about their experience. Except for these questions, all staff, regardless of study arm, receive the same pre-and post-implementation survey questions