Assessing facilitating conditions and barriers for innovation implementation in Canadian long-term care homes: a research protocol
Implementation Science Communications volume 3, Article number: 61 (2022)
The COVID-19 pandemic has profoundly affected the health and care of older adults, with particularly negative consequences for those residing in long-term care homes (LTCH) and retirement homes (RH). To inform the implementation of interventions with the most potential for impact, Healthcare Excellence Canada identified six promising practices and policy options that can be introduced to ensure that LTCH and RH are better prepared for potential future outbreaks. A total of 22 implementation science teams (ISTs) were funded to support LTCH and RH across Canada in their implementation of these practices. This study aims to identify the enablers and barriers to the successful implementation of evidence-based practices and the impact of intervention in LTCH and RH across Canada.
A survey-based longitudinal correlational design will be used. The Organizational Readiness for Knowledge Translation (OR4KT) tool will be used to assess the readiness of LTCH and RH to implement the selected practice. The OR4KT includes 59 questions and takes about 15 min to complete. Five to ten respondents per organization, holding different job positions, will be invited by the ISTs to complete the OR4KT in 91 LTCH or RH across Canada at the beginning of the project (T1) and 6 months after the first measurement (T2).
The study will provide a benchmark for assessing the readiness of LTCH and RH to implement evidence-based practices. It will also inform decision-makers about barriers and facilitators that influence the integration of promising practices in these organizations.
Implementation science is the study of methods and strategies that facilitate the integration of evidence-based practices in health services in a variety of clinical, organizational, and policy contexts . Translating these practices into policies and procedures is one of the greatest challenges in applied health services and policy research, especially given the diversity of contexts . Implementation science theory suggests that context, implementation, and intervention are interdependent and influence each other [3,4,5].
Implementation science research draws on practical experience to generate knowledge on how to adapt an innovation to a context in different regions or conditions and promote its adoption by various populations. Although the implementation of evidence-based innovations is essential to deliver high-quality care , the evidence suggests that the implementation of new evidence-based practices often fails to apply them in a sustainable manner, leading to varying results [7,8,9]. Hence, the need, through rigorous and pragmatic scientific methods, to better ascertain what works, for whom, under what circumstances, and what factors contribute to the success or failure of the implementation process [1, 3, 4].
The COVID-19 pandemic had profoundly impacted the health and care of the elderly, with devastating consequences for people residing in long-term care homes (LTCH) and retirement homes (RH) (also referred to as nursing homes or congregate living settings for older adults) in Canada. Canadian health agencies recorded a higher national proportion of COVID-19 deaths among residents in LTCH and in RH than any other country worldwide, with over 80% of total COVID-19 deaths occurring in LTCH and RH during the first wave [10, 11].
Faced with the possibility that future COVID-19 outbreaks will coincide with the influenza season, authorities of LTCH and RH are rapidly implementing interventions to improve their preparedness and mitigate the effects of any future outbreaks. To inform the implementation of interventions with the greatest potential for impact, the Canadian Foundation for Healthcare Improvement and the Canadian Patient Safety Institute—now Healthcare Excellence Canada (HEC)—conducted a rapid environmental scan . The aim was to identify the promising practices and policy options that could be applied to ensure that LTCH and RH are better prepared for potential future outbreaks. To support the rapid implementation of these practices and in so doing avoid or mitigate the impacts of subsequent waves of the COVID-19 pandemic or another outbreak, an initiative called LTC + Acting on pandemic Learning was launched in July 2020. With the goal of layering on a research/implementation science lens to this work, HEC partnered with the Canadian Institute of Health Research (CIHR) and funding partners (Health Research British Columbia, New Brunswick Health Research Foundation, Saskatchewan Health Research Foundation, Centre for Aging + Brain Health Innovation) to launch the Implementation Science Teams: Strengthening Pandemic Preparedness in Long-Term Care funding opportunity in September 2020. Through this, 22 implementation science teams (ISTs) and their LTCH and RH partners were funded to lead projects on the implementation of one or more of the HEC six defined promising practices including preparation, prevention, people in the workforce, pandemic response and surge capacity, plan for COVID-19 and NON-COVID-19 care, and presence of family . Moreover, to enable ISTs and their partners in LTCH and RH to collectively understand the facilitating factors and barriers to successful implementation along with the impacts of the intervention, all funded ISTs are invited to participate in a Common Measurement Framework (CMF) project. One of the 22 ISTs was mandated to manage the CMF project. The CMF team consists of 11 researchers, experts in implementation science and long-term care.
This study aimed to identify the enablers and barriers to the successful implementation and the impact of the intervention in LTCH and RH across Canada. To this end, the readiness to implement evidence-based practices in LTCH and RH will be assessed using the Organizational Readiness for Knowledge Translation (OR4KT) tool.
The study uses a survey-based longitudinal correlational design to identify organizational factors associated with the successful implementation of evidence-based practices in LTCH and RH by assessing their readiness to implement the six promising practices.
Population and setting
The study population includes employees and managers in all LTCH and RH involved in the 22 IST projects funded through the Implementation Science Teams: Strengthening Pandemic Preparedness in Long-Term Care funding opportunity.
The primary outcome is organizational readiness to apply evidence-based practices using the Organizational Readiness for Knowledge Translation (OR4KT) tool. The tool is based on a solid theoretical foundation and passed through several stages of development and validation, including content evaluation and reliability evaluation, in English, French, and Spanish . The OR4KT is based on existing frameworks to assess organizational readiness to support the implementation of evidence-informed practices . To do so, two systematic reviews, one of organizational readiness theoretical components  and another of organizational readiness measurement tools , have been carried out. The OR4KT includes 59 items grouped under 6 constructs: organizational climate for change, organizational contextual factors, change content, leadership, organizational support, and motivation . The time to complete the questionnaire is estimated at 15 min. Questions are answered on a 5-point Likert scale ranging from 1 = strongly disagree to 5 = strongly agree. The higher the overall score more prepared organizations are to integrate the selected practices and which LTCH and RH are most likely to successfully implement evidence-based practices  (Additional file: OR4KT).
Recruitment and sampling
A total of 22 ISTs from 18 Canadian academic institutions will be invited to participate in the project. The 22 ISTs, comprising 377 IST members, have partnered with a total of 91 LTCH or RH from all 10 Canadian provinces (none of the ISTs includes homes in the 3 Canadian territories). The 22 ISTs are distributed in two cohorts, as categorized by HEC and CIHR: cohort 1 with 14 teams and cohort 2 with 8 teams. In fact, the delay in recruiting cohort 2 teams for this funding opportunity was due to the late reception of additional funding. The CMF team was introduced by CIHR to cohorts 1 and 2 in January and March 2021, respectively, to explain the purpose and tools of the project.
In each LTCH and RH, participants including senior executives (CEO, administrators), middle managers (head nurse, etc.), non-medical staff (housekeeping, food services, etc.), and care workers (health care aids, etc.) will be recruited to participate in the survey. Five to ten participants will be selected from each LTCH and RH by a local implementation science leader for a total of 455 to 910 participants. Given the great variation in size of these LTCH and RH and their staff number, it is not possible to estimate the sample size more accurately. Each IST will contact its affiliated LTCH and RH and decide upon the participation and selection process with respect to respondents (Fig. 1).
The data will be collected in two measurement times T1 (baseline) at the start of the implementation and T2 in post-implementation of the practice, between 2 and 6 months depending on the team. The two data collection times will aim to identify whether changes have occurred in the factors facilitating or constraining the implementation of practices in the LTCH and RH.
We developed a hybrid data collection method to facilitate the collection process by the local implementation science leader, in which questionnaires can be completed on paper or electronically. The questionnaire is available in English and French, the two official languages of Canada. In addition to the 59 OR4KT items, the questionnaire includes four sociodemographic variables for respondents (job title, years of seniority, gender, and age group). Also, descriptive data on LTCH and RH (type of facility, public/private, province, region, number of beds, staff, COVID-19 immunization program) will be provided by senior executives.
The REDCap platform hosted on secure servers at Université Laval will be used for data entry and electronic data collection. For the electronic version, an automatic reminder will be sent to participants if they agreed to participate but have not completed all the surveys. Paper questionnaires will be sent to the Common Measurement Framework (CMF) team by the local leader of the IST by email or scanned and sent electronically. All identifying information will be removed, and all paper questionnaires will be entered manually by a research assistant into the REDCap database and validated by a second research assistant. All data will be stored digitally and backed up on a secure internal server protected by an intrusion detection system and a firewall.
At baseline (T1), sociodemographic data will be used for descriptive and correlational analyses. First, all survey questionnaires from the same LTCH and RH will be grouped, and a mean score will be computed for each variable. Then, the global OR4KT score and its 5 subscales will be calculated for each LTCH and RH. This information will provide an assessment of the baseline readiness score. In a previous study, an OR4KT score of 64 out of 100 was associated with a high level of readiness to implement new practices in primary care . As there are currently no data on LTCH and RH, we will use this score as a cutoff point to dichotomize the readiness level of LTCH and RH at baseline. We will perform a logistic regression to identify the organizational characteristics associated with the level of readiness of LTCH and RH to implement new practices.
At follow-up (T2), the mean scores and differences in scores (T2 − T1) will be calculated for the overall and subscale scores of the OR4KTfor each LTCH and RH. Considering the baseline OR4KT scores, we will identify which organizational characteristics are associated with a change in the OR4KT scores between T1 and T2 using ANOVA. We will also compare the characteristics of the homes that will show significant improvement, reduction, or no change in the OR4KT score over the 6-month period. We will use a generalized estimating equation model to evaluate the effect of organizational and contextual variables (organization size, organization type, region, vaccination site, etc.) on the OR4KT score differences, a modeling method adapted for longitudinal data .
According to articles 2.1 and 2.5 of the Tri-Council Policy Statement , the project does not require approval by a research ethics board. The Integrated Health and Social Services Centres de Chaudière-Appalaches research ethics board (REB) analyzed the associated information and documents and confirmed that the project does not involve living human participants or human biological material and is a quality assurance and quality improvement study. The data collection does not include any personally identifiable information from participants. However, a data sharing agreement has been drawn up by Université Laval and the 22 ISTs. The data sharing agreement protects the collection and transfer of data gathered by disclosing parties. It also protects the assessment and analysis of data by the receiving party. Based on the approval and signing of the data sharing agreement by the research ethics board of each IST, the latter agrees to share its data.
We follow the integrated knowledge translation planning guide from the CIHR . At the launch of the project, the complete research plan was presented to the knowledge users, namely the IST members, HEC, and CIHR, during an online meeting. Participants were invited to ask questions to the CMF team. Over the course of the project, we will organize at least two knowledge translation meetings, one at the midterm of the research process and another one at the end of the project. We will integrate all relevant comments and provide any data that is requested, respecting the conditions stated in the data sharing agreement.
To facilitate communication between the CMF team, the 22 ISTs, and between the teams, a group has been created on the collaborative communication platform Slack. In addition, the exchange of information and documents related to the CMF project (protocol, data sharing agreement, questionnaire) was carried out through different communication methods such as emails, Slack, Zoom, and Teams meetings.
The Common Measurement Framework project will also include virtual knowledge exchange activities with the goal of promoting inter-team learning to mobilize experiential knowledge and research results in order to identify common indicators and set priorities. To facilitate these exchanges, a virtual community of practice for all ISTs will be accessible via Slack.
For each LTCH and RH, a global score of organizational readiness to implement evidence-based practices will be determined, as well as scores for the subscale’s organizational climate for change, organizational contextual factors, change content, leadership, organizational support, and motivation. In addition, a list of indicators affecting the implementation of promising practices and the overall impact of these measures in LTCH and RH will be identified and shared in an anonymized report. We will collaborate closely with ISTs to initiate a conversation on how to leverage the facilitating factors and avoid barriers in the implementation of best practice innovation. The collaboration could lead to a tool kit to be used by LTCH and RH and more broadly outside of the IST initiative. The results of this study could inform decision-makers, LTCH, and RH about the facilitating factors and barriers to implement evidence-based practices.
Availability of data and materials
OR4KT is available as an additional file.
Long-term care homes
Coronavirus disease of 2019
Healthcare Excellence Canada
Common Measurement Framework
Implementation science team
Organizational Readiness for Knowledge Translation
Research Electronic Data Capture
Canadian Institutes of Health Research
Bauer MS, Damschroder L, Hagedorn H, Smith J, Kilbourne AM. An introduction to implementation science for the non-specialist. BMC Psychology. 2015;3:32.
Squires JE, Hutchinson AM, Coughlin M, Bashir K, Curran J, Grimshaw JM, Dorrance K, Aloisio L, Brehaut J, Francis JJ, Ivers N, Lavis J, Michie S, Hillmer M, Noseworthy T, Vine J, Graham ID. Stakeholder perspectives of attributes and features of context relevant to knowledge translation in health settings: a multi-country analysis. Int J Health Policy Manag. 2021. https://doi.org/10.34172/ijhpm.2021.32.
Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Jeffery AA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implementation Sci. 2009;4:50.
Dixon-Woods M, Bosk CL, Aveling EL, Goeschel CA, Pronovost PJ. Explaining Michigan: developing an ex post theory of a quality improvement program. Milbank Q. 2011;89(2):167–205.
May CR, Johnson M, Finch T. Implementation, context and complexity. Implementation Sci. 2016;11:141.
Department of Health: Innovation, health and wealth: accelerating adoption and diffusion in the NHS department of health. 2011, Department of Health
Scheirer MA. Is sustainability possible? a review and commentary on empirical studies of program sustainability. Am J Eval. 2005;26(3):320–47. https://doi.org/10.1177/1098214005278752.
Stirman SW, Kimberly J, Cook N, Cook N, AC Castro F, Charns M: The sustainability of new programs and innovations: a review of the empirical literature and recommendations for future research. Implementation Sci. 2012; 7(17). https://doi.org/10.1186/1748-5908-7-17
Ham C, Kipping R, McLeod H. Redesigning work processes in health care: lessons from the national health service. Milbank Q. 2003;81(3):415–39. https://doi.org/10.1111/1468-0009.t01-3-00062.
Canadian Institute for Health Information. New analysis paints international picture of COVID-19’s long-term care impacts. June 25, 2020. Available from: http://emktg.cihi.ca/ViewEmail.aspx?em_key=08jafBPP2lXCQzTRLz6rSCxyfUk+dfkDpRYQwdGchCoOfLXGIWW6Y6UWEMHRnIQqp03BjiwW7pQ5bqfdhCmHXL3vARe3YTEE&em_source=html
Estabrooks CA, Straus S, Flood CM, Keefe J, Armstrong P, Donner G, Boscart V, Ducharme F, Silvius J, Wolfson M. Royal Society of Canada. Restoring trust: COVID-19 and the future of long-term care. Royal Society of Canada. 2020. https://rsc-src.ca/sites/default/files/LTC%20PB%20%2B%20ES_EN.pdf. Accessed 4 October 2020.
Canadian Foundation for Healthcare Improvement & Canadian Patient Safety Institute. Healthcare Excellence Canada. Reimagining care for older adults, next steps in COVID-19. Response in long-term care and retirement homes, what we heard. 2020. Available from: https://www.cfhi-fcass.ca/docs/default-source/itr/tools-and-resources/reimagining-care-for-older-adults-covid-19-e.pdf.
Gagnon MP, Attieh R, Dunn S, Grandes G, Bully P, Estabrooks CA, Légaré F, Roch G, Ouimet M. Development and content validation of a transcultural instrument to assess organizational readiness for knowledge translation in healthcare organizations: the OR4KT. Int J Health Policy Manag. 2018;7(9):791–7.
Attieh R, Gagnon MP, Estabrooks CA, Légaré F, Ouimet M, Vazquez P, Nuño R. Organizational readiness for knowledge translation in chronic care: a Delphi study. BMC Health Serv Res. 2014;14:534.
Attieh R, Gagnon MP, Estabrooks CA, Légaré F, Ouimet M, Roch G, Ghandour el K, Grimshaw J. Organizational readiness for knowledge translation in chronic care: a review of theoretical components. Implementation Sci. 2013;138 https://doi.org/10.1186/1748-5908-8-138
Gagnon MP, Attieh R, el Ghandour K, Légaré F, Ouimet M, Estabrooks CA, Grimshaw J. A systematic review of instruments to assess organizational readiness for knowledge translation in health care. PLoS ONE. 2014;9(12):e114338.
Grandes G, Bully P, Martinez C, Gagnon MP. Validity and reliability of the Spanish version of the Organizational Readiness for Knowledge Translation (OR4KT) questionnaire. Implementation Sci. 2017;12(1):1–1.
Wang M. Generalized Estimating Equations in Longitudinal Data Analysis: A Review and Recent Developments. Advances in Statistics. 2014; 2014; 303–728. https://doi.org/10.1155/2014/303728.
Tri-Council Policy Statement (TCPS-2 2018). Ethical conduct for research involving humans. https://ethics.gc.ca/eng/documents/tcps2-2018-en-interactive-final.pdf. Retrieved on January 7th, 2022.
Andrews D, Fong G, Hackam D, Li L, Lynam M, Mathews M, Russell D, Angus D, Piazza L, Strauss S. Guide to knowledge translation planning at CIHR: Integrated and end-of-grant approaches. Can Inst Health Res. 2012;1–34. https://publications.gc.ca/collections/collection_2012/irsc-cihr/MR4-11-2012-eng.pdf.
We would like to acknowledge the collaboration of the principal investigators of the Implementation Science Teams: Strengthening Pandemic Preparedness in LTC initiative, in particular, Emily McDonald, Andrea Laboni, Idrissa, Beogo, Sharon Kaasalianinen, Peter Tanuseputro, Natasha Gallant, Katherine S McGilton, and Zahra Goodarzi.
We are grateful for the support provided by the statistician Mr. Stephane Turcotte and the linguistic center of Anne Mcbryde Traduction.
The CMF project was funded by the Canadian Institutes of Healthcare Research (CIHR) (grant number: 174034, in partnership with the Healthcare Excellence Canada (HEC)). The funding sources have not been involved in the study design, collection, analysis and interpretation of the data, writing of the report, or decision to submit the article for publication. The study protocol has been peer reviewed by the funding body.
Ethics approval and consent to participate
An exemption was granted on January 15, 2021, for the CMF project (Project #2021–851—ESMO-CMC) by the Integrated Health and Social Services Centres de Chaudière-Appalaches research ethics board. The exemption covered all 22 teams. Not all participants will need to provide a written consent form.
Consent for publicaton
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Hardy, MS., Sasseville, M., Attieh, R. et al. Assessing facilitating conditions and barriers for innovation implementation in Canadian long-term care homes: a research protocol. Implement Sci Commun 3, 61 (2022). https://doi.org/10.1186/s43058-022-00312-3
- Implementation science
- Long-term care
- Organizational readiness
- Common measurement