- Research
- Open access
- Published:
Reducing work pressure and IT problems and facilitating IT integration and audit & feedback help adherence to perioperative safety guidelines: a survey among 95 perioperative professionals
Implementation Science Communications volume 1, Article number: 49 (2020)
Abstract
Background
To improve perioperative patient safety, guidelines for the preoperative, peroperative, and postoperative phase were introduced in the Netherlands between 2010 and 2013. To help the implementation of these guidelines, we aimed to get a better understanding of the barriers and drivers of perioperative guideline adherence and to explore what can be learned for future implementation projects in complex organizations.
Methods
We developed a questionnaire survey based on the theoretical framework of Van Sluisveld et al. for classifying barriers and facilitators. The questionnaire contained 57 statements derived from (a) an instrument for measuring determinants of innovations by the Dutch Organization for Applied Scientific Research, (b) interviews with quality and safety policy officers and perioperative professionals, and (c) a publication of Cabana et al. The target group consisted of 232 perioperative professionals in nine hospitals. In addition to rating the statements on a five-point Likert scale (which were classified into the seven categories of the framework: factors relating to the intervention, society, implementation, organization, professional, patients, and social factors), respondents were invited to rank their three most important barriers in a separate, extra open-ended question.
Results
Ninety-five professionals (41%) completed the questionnaire. Fifteen statements (26%) were considered to be barriers, relating to social factors (N = 5), the organization (N = 4), the professional (N = 4), the patient (N = 1), and the intervention (N = 1). An integrated information system was considered an important facilitator (70.4%) as well as audit and feedback (41.8%). The Barriers Top-3 question resulted in 75 different barriers in nearly all categories. The most frequently reported barriers were as follows: time pressure (16% of the total number of barriers), emergency patients (8%), inefficient IT structure (4%), and workload (3%).
Conclusions
We identified a wide range of barriers that are believed to hinder the use of the perioperative safety guidelines, while an integrated information system and local data collection and feedback will also be necessary to engage perioperative teams. These barriers need to be locally prioritized and addressed by tailored implementation strategies. These results may also be of relevance for guideline implementation in general in complex organizations.
Trial registration
Dutch Trial Registry: NTR3568.
Background
Rising demands for efficiency, effectiveness, and safety with increasingly limited resources put healthcare systems worldwide under pressure to continuously deliver high-quality and safe care [1, 2]. It is recognized that implementation of best practices in healthcare is slow, incomplete, and often not sustainable, with variations in compliance [3].
In 2008, the World Health Organization (WHO) Surgical Safety Checklist was introduced to ensure the consistent use of safety processes [4]. The application of the WHO checklist has led to reductions in adverse events [5] and cost savings [6]. In the Netherlands, three novel guidelines with recommendations for a safe preoperative, peroperative, and postoperative care pathway including Patient Safety Indicators (PSIs) (see Additional file 1) were published [7,8,9,10]. These recommendations involve the process and organization of perioperative care, instead of the clinical content of the care process, with descriptions of responsibilities and standardization of methods to reduce risks related to—among others—handovers, wrong-site surgery, infection prevention, allergies, retained surgical clamps or sponges, and blood-clotting problems. In addition, several stop moments, i.e., stopping rules translated into a checklist, have been introduced, such as the preoperative screening, the time-out, and the sign-out, in order to check whether agreements have been met and a patient can go to the next phase in the care process (all stop moments in the perioperative trajectory have to be performed in each surgical patient). The goal of the guideline initiative is a culture that demonstrably improves perioperative outcomes by the timely administration of antibiotic prophylaxis where indicated and the performance of the entire STOP bundle (i.e., a composite outcome defined as the percentage of patients in which all the stop moments in the whole perioperative care process have been performed) in all patients.
Implementation of these perioperative safety guidelines is expected to reduce adverse patient outcomes. Several studies showed that using stop moments and the timely administration of antibiotic prophylaxis improve perioperative outcomes [5, 11, 12]. Adherence to these guidelines has, however, shown to be far from optimal [10]. These results clearly show that a thorough analysis of the barriers and drivers for adherence to the perioperative safety guidelines is essential to further improve perioperative patient safety.
One of the most consistent findings in healthcare services research is the gap between best practice on the one hand and the actual clinical care on the other. Despite the considerable efforts in developing and implementing evidence-based guidelines, only a modest impact has been found on clinical practice [13,14,15,16,17]. Producing change is usually less easy, particularly when multiple medical and paramedical disciplines are involved or the innovation requires complex changes in clinical practice, better collaboration between disciplines, or changes in the organization of care. A comprehensive study in the USA showed that only about half of the patients (55%) received recommended care as described in the guidelines [18]. In addition, it has been demonstrated that changing physicians’ behavior is extremely difficult [19]. From a psychological perspective, this is called the “knowledge-behavior gap,” indicating the difference between what we know we should do and what we actually do in clinical daily practice [3, 19]. Reflecting on this failure of implementation, most experts in healthcare improvement now emphasize the crucial importance of acquiring a good understanding of the problem, the target group, its setting, and the obstacles to change [20]. To bridge the gap between desired and current patient care, we need an in-depth understanding of the barriers and incentives to achieve change in practice. In general, little is known about the processes and factors responsible for how healthcare professionals change their practice methods when they have to adhere to a new guideline and do something they did not do before.
Many factors may influence the implementation of the perioperative safety guidelines in practice. In scientific research on determinants of change, it is important to obtain a comprehensive insight into these factors. A theoretical approach can help explain these factors and possibly help target interventions. To answer our research question and structure the analysis, we used a framework of Van Sluisveld et al. [21] that provides insight into the process of the implementation of scientific evidence, as well as into factors influencing this process. This framework is based on three models related to implementing change: the implementation of change model of Grol and Wensing [22, 23], the framework of knowledge–attitude–behavior-related barriers for guideline adherence of Cabana et al. [19], and the framework for adherence to clinical practice guidelines in the intensive care unit (ICU) of Cahill et al. [24]. Measuring determinants is thus a first and basic activity for all researchers and implementation supervisors. The Dutch Organization for Applied Scientific Research (TNO) has developed a short diagnostic tool for this [25]. The TNO has been conducting research since 1999 into determinants that predict the actual use of innovations. In 2012, the organization performed a meta-analysis to arrive at an empirically supported list of 29 determinants, which has been converted into a generic diagnostic tool: the Measurement Instrument for Determinants of Innovations (MIDI). Based on the literature [21, 23], the following seven categories of factors can be identified: features of the innovation itself (e.g., complexity, credibility, amount of information, feasibility), features of the societal context (e.g., political developments and policies, legal obligations, and regulations), features of the interventions used for implementation and dissemination (e.g., exposure to implementation efforts), features of the institutional context (e.g., organizational structure, organization of care and logistic processes, time, [qualified] staff, task divisions, [financial] resources, equipment, IT structure), features of the social setting (e.g., behavior of colleagues, collaboration, culture in the team), features of the target group of professionals who should use the innovation (e.g., their awareness, knowledge, motivation, opinions, attitudes, behavioral routines, habits, expectations), and features of the patients (e.g., their capacities, preferences) [21, 23].
Tailored and barrier-driven implementation strategies are needed to improve adherence to guidelines in practice. An adequate analysis of barriers and facilitators to the implementation of a guideline is considered to be a first and important step in improving guideline adherence and subsequently quality and safety of care [3, 20]. The barriers and facilitators identified can be used to develop tailored implementation strategies. Systematic tailoring entails (at least) three key steps: identification of the determinants of practice (i.e., barriers and facilitators), designing implementation interventions appropriate to the determinants, and application (and evaluation) of implementation interventions that are matched to the identified determinants [26]. In this study, relevant barriers and drivers for the implementation of the perioperative safety guidelines and more specifically the stop moments were explored and prioritized, aiming to offer opportunities to develop determinant-driven and tailored interventions to improve the implementation and use of the perioperative guidelines in practice. Some of the determinants will be generic (they influence many implementation processes), while others will be specific to the guidelines being implemented. We also acknowledged the role of the context in implementation. The factors that determine whether the implementation of an innovation is successful or not are many and varied. Factors may be connected to the setting in which the innovation is to be implemented. Each target group or setting is, in some sense, unique. There are often clear differences between groups of care providers and hospitals with respect to their barriers and drivers for change. Effective implementation, therefore, cannot take place without an analysis of the setting and the target group in which the implementation is to take place. We, therefore, also performed subgroup analyses as in the study of Van Sluisveld et al. [27].
Methods
Study design
An anonymous online questionnaire survey about factors that may influence the implementation of the perioperative safety guidelines was conducted among 46 anesthesiologists, 33 surgeons, 124 nurses (42 operation room (OR), 34 anesthesia, 23 recovery, and 25 ward), and 29 ICU employees in all nine hospitals enrolled in the IMPROVE (IMPlementatie Richtlijnen Operatieve VEiligheid (Implementation of Perioperative Safety Guidelines)) study [28] (two academic, four tertiary teaching, and three regional hospitals). We asked the contact persons to provide the contact data of at least one respondent per discipline. Because of the expected low respondence rates, we used an information-oriented selection strategy to maximize the utility of information from single cases or small samples. The respondents were purposively selected as key professionals by the contact persons in their hospitals on the basis of relevance (expectations about their information content). After pilot testing the questionnaire within the IMPROVE research team for comprehensibility, completeness, overlapping questions, and length, the questionnaire was sent by e-mail, followed by two reminder e-mails after 1 and 3 weeks, respectively. Informed consent was implied by completion and return of the questionnaire.
Questionnaire
The questionnaire was self-developed, based on the theoretical framework for classifying barriers and facilitators as described by Van Sluisveld et al. [21]. According to this framework, barriers and facilitators are grouped according to whether they are related to the intervention, society, implementation, organization, professional, patient, or social factors. The content was derived from the instrument for measuring determinants of innovations by TNO [25], from the publication of Cabana et al. [19] about why physicians do not follow clinical practice guidelines, and from the results of 19 individual semi-structured interviews with quality and safety policy officers and perioperative key professionals in five Dutch hospitals. These interviews were held during the development process of the PSIs belonging to the perioperative safety guidelines [28]. The interviews were audio recorded over the phone. Interviewees were asked, by means of a topic guide, about the factors that hindered or aided the guideline implementation process.
The final questionnaire covered six sections: (1) demographic and professional characteristics; (2) guideline adherence topics: the intervention characteristics, the societal context, the institutional characteristics, the social context, the professional characteristics, and the patient characteristics; (3) adherence to the stop moments; (4) local implementation; (5) prioritizing barriers into a personal top-3 list; and (6) wishes and needs with respect to the future implementation of the guidelines. Respondents were asked to score the statements on a five-point Likert scale or to answer open-ended questions on their opinions (e.g. “how can the implementation be improved?”) and ranking their three most important barriers. The professionals were also asked to score the motivation or readiness within their discipline to work or start working according to the perioperative guidelines on a 10-point scale (1 = my discipline is not motivated nor willing to work according to the perioperative guidelines and to perform the stop moments; 10 = my discipline is fully motivated and willing to work according to the perioperative guidelines and to perform the stop moments).
Data analysis
The questionnaire results were analyzed using SPSS 20. In case of incomplete surveys, we applied pairwise deletion of missing values. Thus, for each analysis, questionnaires were excluded from the analysis only if the concerning variables could not be derived from the questionnaire due to missing data in that questionnaire. Descriptive statistics were used (percentages, mean, standard deviation). We first recoded the statements that were negatively formulated to match those positively formulated (so that a higher score indicated a positive response). We then grouped the statement scores 1 and 2, indicating a negative response (disagreement with the statement), as well as the scores 4 and 5, indicating a positive response (agreement with the statement). The score 3 indicated a neutral response. We sorted the statements in a table, in which 100% was the highest (i.e., all respondents scored the statement as positive) and 0% was the lowest measure of agreement. We considered a statement to reflect a perceived barrier if fewer than 50% of the respondents scored the statement as positive (score 4 or 5).
To explore whether there were differences in answers with regard to the statements between subgroups based on discipline and hospital type, we conducted subgroup analyses, i.e., Student’s t tests with a p value < 0.05 as threshold to signal differences.
Results
Characteristics of the respondents
We received 95 completed questionnaires, resulting in a response rate of 41%. Thirty-two percent of the questionnaires were incomplete, with one or more questions missing. There was no indication that “sensitive” questions were avoided. Questionnaires were deleted from the analysis only if the required question was missing. This resulted in analyses of 93–99% of the questionnaires. The majority of the professionals were female (56%). Respondents had 18.6 ± 9.9 years (range 1–40 years) of work experience in their current function and 15.8 ± 10.7 years (range 1–42 years) of work experience in their current hospital. All respondents were contracted to only one of the included hospitals, with 80% affiliated to non-academic hospitals. Eight percent had a function other than the prespecified professions (see the “Study design” section), e.g., OR executive; operational executive; head of the OR; surgical team, OR team, or nursing ward team leader. Response was lowest among ward nurses (response rate of 20%), OR nurses (28%), and ICU employees (34%). The response of the other disciplines was > 41%. Table 1 summarizes the demographic and professional characteristics of the responding professionals.
Adherence to the stop moments
Sixty-five percent of the respondents reported that the performance of the stop moments was fully integrated in the daily routines of the perioperative process within their hospital. According to 69% of the respondents, stop moments were sometimes skipped.
Perceived barriers
Fifteen of the 57 statements (26.3%) were considered to be barriers (Table 2). These had to do with the following:
-
1.
Social context: Respondents did not care about the opinion of their colleagues; difficulty in bringing the entire team together to carry out a stop moment; colleagues did not always set a good example; the experience of (social) pressure to work not according to the perioperative guidelines; and the impression that their hospital has no open culture, in which everyone should dare to speak up in a social atmosphere of perceived safety
-
2.
Organizational characteristics: the perception that no measures were taken by their hospital to ensure that new employees are adequately instructed in the application of the perioperative guidelines; a lack of financial resources and insufficient time to integrate the perioperative guidelines in their daily work; and no evaluation of the results of working according to the perioperative guidelines in terms of patient safety (e.g., mortality or complications)
-
3.
Professional characteristics: the perception of a safety problem in their hospital; no clear opinions on the distribution of tasks and responsibilities with regard to perioperative care; the perception that working according to the guidelines takes a lot of time (delaying the workflow), which goes at the expense of production and leads to increased work pressure
-
4.
Patient characteristics: respondents thought that patients did not expect them to apply the perioperative guidelines
-
5.
Intervention characteristics: difficulty to adjust daily routines accordingly to the guidelines
Local implementation
Sixty-one percent of the respondents participated in the implementation interventions in their hospital. Reasons for not participating were: time pressure (37%); absence during the interventions (35%); no priority (19%); no obligation (11%); doubts about the added value of the interventions (8%); and colleagues did not also participate (3%).
Perceived facilitators for future implementation
On average, motivation was valued at 7.5 out of 10 (SD = 1.28; range = 4–10).
The majority of health professionals reported that integrated information systems (70.4%) and audit and feedback (41.8%) were the most useful tools to support the appliance of the perioperative guidelines and stop moments. Furthermore, approximately 37% of our respondents indicated that education would improve the implementation of the guidelines, whereas 36% indicated that they would like (digital) checklists. Thirty-three percent wished for more administrative support, and 24% requested the availability of more computers, smartphones, or tablets to fill out the checklists.
In Additional file 2, the answers to the open-ended questions are provided.
Barriers Top-3
A total of up to 75 unique barriers to effective guideline implementation were found (Table 3). Sixty-nine professionals reported at least one barrier, 54 professionals ranked at least two barriers, and 35 professionals ranked three barriers. Overall, organizational barriers were most frequently reported.
The most frequently mentioned barriers concerning the innovation itself were skepticism with regard to the perioperative safety guidelines, which were considered to lack scientific evidence and to have a complex nature (i.e., unclear and ambiguous). A barrier regarding the implementation of the guidelines was a lack of timeliness, i.e., no early exposure to the implementation efforts. Frequently mentioned organizational barriers were time pressure, IT problems and lacking IT facilities, workload, suboptimal organizational preconditions (e.g., preparations were not adequately performed), and incomplete, missing, or wrong relevant information. Two important barriers regarding the social context were cultural problems (sense of awareness, but no broad support by everyone) and a lack of collaboration (i.e., not working together as a well-coordinated team). Frequent barriers at the level of the professional were defensive and disruptive attitudes and personal opinions toward the guidelines (i.e., finding the guidelines too excessive and the opinion that adherence to the guidelines may create a wrong sense of safety by weakening independent thinking and responsibility taking), behavioral routines that require adjustment, and a lack of awareness and knowledge about the importance and purpose of the guidelines. Perceived applicability of the stop moments during urgency care was the most important barrier at the patient level.
Subgroup analyses
We found signals for possible differences in answers between perioperative key disciplines (see Additional file 3). Also, differences between types of hospital seemed to be present. For example, more respondents of peripheral hospitals than of academic or tertiary teaching hospitals seemed to think that measures are taken in their hospital to ensure that new employees are adequately instructed in the application of the perioperative guidelines. Respondents from tertiary teaching hospitals appeared to more often state to have an opinion leader/innovator within their discipline than respondents from academic or peripheral hospitals. Overall, subgroup analyses showed in 25% of the statements signals for differences between subgroups.
Discussion
This nationally representative study identified 75 barriers to the success of the implementation of the perioperative safety guidelines, relating to time constraints, time pressure in emergency procedures, insufficient IT support and facilities, experienced increased workload, non-constructive attitudes and opinions toward the guidelines, lack of clinical documentation (i.e., missing, incomplete, or wrong information), suboptimal culture, lack of awareness, and knowledge about the importance and purpose, poor teamwork, lack of scientific evidence, complexity of the guidelines, lack of exposure to implementation efforts, suboptimal organizational preconditions, and lack of motivation to change behavioral routines. Several barriers already identified [19, 27, 29,30,31,32] were confirmed; these included a lack of time, inappropriateness in certain contexts such as emergencies, insufficient awareness, resisting opinions and insufficient knowledge of the professionals, inadequate IT infrastructures, social factors such as a suboptimal culture and collaboration (i.e., teamwork issues), skepticism regarding the evidence base, and inability to overcome the inertia of previous practice. However, we were not able to find other publications relating specifically to barriers concerning perioperative guidelines. Much research has been done on other guidelines and among other disciplines such as general practitioners, but the perioperative setting is underrepresented in implementation studies. Characterization of barriers and drivers to guideline implementation in this area is still needed.
The majority of the involved healthcare professionals seemed to agree with the specific guidelines and the concept of guidelines in general. Seventy-eight percent of the respondents felt (very) positive about guidelines in general. Other studies focusing on physicians’ attitudes toward guidelines demonstrated overall positive attitudes as well [33, 34]. Seventy-six percent believed that following the perioperative guidelines improves patient safety. Outcome expectancy is the expectation that a given behavior will lead to particular consequences; if a healthcare professional believes that a recommendation will lead to improved outcomes, adherence to this recommendation is more likely [35]. Motivation to work or start working according to the perioperative guidelines was valued at 7.5 on a scale of 10. Motivation of OR team members is considered essential for compliance with checklist use [36].
Only 56% of the respondents received regular feedback about perioperative incidents and complications that took place in their hospital. This might explain why only 51% of the responding healthcare professionals thought that the effects of using the guidelines are clearly visible. Furthermore, in line with previous literature [32], 42% considered a culture of audit and feedback as an important facilitator for the use of the perioperative safety guidelines.
It was remarkable that more than half of the respondents (54%) sometimes experienced (social) pressure not to work according to the perioperative guidelines and just one third (33%) perceived the relational culture of their hospital as open. In addition, only half of the respondents (51%) thought that everyone takes their responsibility in addressing each other in unsafe situations and guideline non-adherence. These issues often stem from a hierarchical team culture that obstructs the open culture and communication required to use the guidelines correctly. In almost all cases, an overly hierarchical culture is negatively associated with implementation of quality improvement and related practices. Riesenberg et al. [37] already reported communication barriers related to social structures and hierarchies in a study on nursing handoffs. To improve the safety culture, interventions should aim at minimizing this hierarchy [29]. The use of checklists is expected to improve communication among the OR team by the reduction of hierarchy barriers and unfamiliarity [38]. In particular, introducing every single team member by name and function before incision might create an atmosphere of mutual respect and acceptance and good team communication [39]. The existing hierarchies and the differential interprofessional status accorded to those in different disciplines must be altered in order to create psychological safety. Each member has to be allowed to take interpersonal risk by speaking up if any concern about safety arises without being afraid of being embarrassed, rejected, or punished [40, 41]. Psychological safety is a key antecedent of speaking up and learning behavior in healthcare teams [40].
In line with earlier literature [42], 42% of the respondents thought it was sometimes difficult to bring the entire team together to carry out a stop moment. Also, stop moments were performed when key professionals were absent or some staff were doing tasks away from the patient. This was also confirmed by the open responses in our study: “Doctors are not always on time or busy with several things at the same time (for example, looking at a patient on the ward). In order not to hamper the process, this will continue, without paying enough attention to the time-out. Sign-out agreements are almost always not discussed by the surgeon involved. OR assistants often spend time in the sterile preparation room during the time-out, so that none of them are present.”
“It remains difficult for some doctors to complete the questionnaire point by point with the whole team. Often, this is still a kind of a private chat. We do not always wait until the team is complete. Some colleagues continue with other ‘jobs’ during ‘topping’. In my opinion this should be a moment where everyone stops with what they are doing and finishes the TOP list as a team with full attention.”
Poor use of checklists has also the potential to deepen existing cultural division and further deteriorate interprofessional dynamics. When dominant team members decide to do the checks among themselves, other members of the team may feel excluded [43].
The most commonly mentioned barrier in the Barriers Top-3 was a lack of time. This was also confirmed by the results on the relevant barrier statement: only one third of the respondents (37%) experienced sufficient time to integrate the perioperative guidelines in their daily work. Consulting patients in an emergency situation was the next common barrier: 19% of the professionals perceived the guidelines to be inappropriate for time-pressured emergencies. These two barriers as well as workload are related to each other and have to do with work pressure and stress.
Time constraints are an external barrier. This may explain the discrepancy between the relative high motivation to work or start working according to the perioperative guidelines (a score of 7.5 out of 10) and actual guideline adherence in practice [10]. The conflict between time constraints as well as economic constraints and patient safety may also lead to increased stress for the personnel and negatively influence job satisfaction [44]. However, the performance of stop moments during urgent surgical procedures is not an external barrier and is under the healthcare professionals’ control. This barrier has to do with staff attitude and personnel’s conceptions of time and patient safety. The time investment of a stop moment in case of urgency is experienced as wasted time by many healthcare professionals. However, it has never been proven that the time spent conducting the stop moments takes too long in such a situation, and the duration of an average time-out procedure (1 to 3 minutes) [unpublished observation] does not confirm this either. Moreover, stops 1 and 3 do not apply in case of urgency, but this should not affect the execution of the other stop moments in the perioperative trajectory of emergency patients. Especially in urgent interventions, the risk of errors and complications is greater. In these circumstances, the execution of the stop moments is considered even more important.
A methodological strength of this study is the basis of an existing theoretical framework from the field of implementation science [21] for the online questionnaire with supplementary open-ended questions in order to obtain open responses. In this way, we tried to avoid that the determinants examined were solely dependent on the researchers’ selection and allowed the full range of implementation determinants and experiences to be explored. Our in-depth analysis of barriers and drivers provides detailed and new information to develop multifaceted implementation strategies for improving the implementation process of the perioperative safety guidelines. To the best of our knowledge, this is the first overview of quantitative research on the barriers and facilitators regarding the implementation of the national perioperative safety guidelines (with a multicenter hospital sample). We acknowledge that much has been written about (barriers and facilitators toward) the implementation of safety interventions such as surgical safety checklists. However, we have to make a distinction here. Our study concerned barriers and drivers for the implementation of guidelines that cover the complete perioperative process. That is something else than a single intervention. Parts of these guidelines, such as the stop moments, can be translated into a single intervention as, for example, a checklist. However, our study took the implementation of the entire underlying perioperative safety guidelines into consideration. By including different perioperative key disciplines from different types and sizes of hospitals, covering a representative sample of nine hospitals with geographic spread to cover multiple regions across the Netherlands, we ensured a breadth of perspectives, increasing the generalizability of our research. This generalizability may even partly hold for other areas than the perioperative one; some of the barriers and facilitators probably do not only apply for guideline implementation in the perioperative setting, since similar barriers and drivers have been previously identified as determinants influencing the implementation of change in healthcare [19, 2730, 31]. The themes that emerged from this research probably represent the determinants that play a role in the implementation of many change initiatives in healthcare and hence present a valuable learning opportunity. Moreover, our study showed that the barriers and drivers on single safety interventions (e.g., surgical safety checklist) [29, 32] and the perioperative safety guidelines resemble each other. The response rate to the questionnaire of 41% was quite good, although we still collected opinions from a relatively small sample of perioperative healthcare professionals. Moreover, the response rate showed a skewed distribution. Anesthesiologists were somewhat overrepresented, and ward nurses were less well represented. This may, on the other hand, limit the ability to generalize our findings. Future studies would do well to aim for larger sample sizes, as the number of included hospitals was also small compared with the overall number of Dutch hospitals. Our study had several other limitations. Using a purposive, stratified sampling strategy based on relevance may have resulted in capturing the professionals with the strongest views about the guidelines and who are passionate about sharing them, meaning that we may have missed some valuable feedback from those whose opinions are less pronounced. Or those with a positive attitude toward guidelines may be overrepresented in our sample. We could not access demographic data of the non-respondents for reasons of confidentiality and were therefore unable to analyze the representativeness of our respondents. A non-response analysis could have provided more insight in this issue, but was unfortunately not feasible in the present study. Moreover, no postal addresses or telephone numbers were available to us, so we could reach respondents only via professional mail. Therefore, we were unable to increase the response rate by using additional methods to reach out to potential respondents. Non-response bias may, however, not be as crucial in health professionals’ surveys as in surveys of the general population [45]. Healthcare professionals are as a group more homogeneous regarding knowledge, training, attitudes, and behavior than the general population [45]. In previous studies analyzing non-respondents of survey research, non-response bias was suggested in research in which women, recently licensed, and younger medical specialists were more likely to respond [46, 47]. However, our study population consisted of a varied sample in terms of gender and experience. Furthermore, the reliability and validity of this non-validated survey is unknown. Replication of study results and analysis of questionnaire items is therefore warranted. Also, the perceived barriers depend on the situation-related perception of the healthcare professionals and may not accurately reflect the whole spectrum of barriers. Lastly, this analysis specified a list of barriers that were believed to influence implementation of the perioperative safety guidelines, but did not specify the interactions between them.
Implementation of new hospital processes is complex and requires careful evaluation and understanding of potential barriers and drivers. The results of this study provide input to improve the adherence to the Dutch national perioperative safety guidelines in practice. Besides, our findings may be useful to take into account in the process of updating these guidelines (to raise acceptance and implementability) as well as in the development and updates of other guidelines that need to be implemented in complex and high-risk environments in healthcare. These study results also emphasize that the implementation context (different hospital types and disciplines) seems to play some, but no overarching role in the identification of barriers toward the implementation of the perioperative safety guidelines.
The majority of health professionals in this study considered the presence of integrated information systems and audit and feedback as useful tools to support the use of the perioperative guidelines and stop moments. The implementation process of the perioperative guidelines could be enhanced by hospitals stimulating a culture of regularly feeding-back local data and results, in order to create learning experiences and insights in the effects of the guidelines. The regular provision of data and feedback would significantly increase buying into an intervention, particularly for those doubting its relevance, as reported by a qualitative evaluation of the barriers and facilitators to the implementation of the WHO surgical safety checklist across hospitals in England [32]. Therefore, it is important to focus on developing methods by which information on the impact of the guidelines can be captured, fed-back, and discussed periodically. Not doing so ultimately jeopardizes buy-in.
Future research should focus on identifying barriers at the recommendation level. For now, we only looked at the barriers that apply to the overall implementation process of the guidelines, not to individual guideline recommendations. A detailed analysis of the individual guideline recommendations may help in deciding where to focus the implementation efforts. Also, substantial improvements can be achieved by focusing on the barriers that are widely applicable across recommendations.
Conclusions
The national perioperative safety guidelines were a safety improvement initiative required to be implemented in all Dutch hospitals. This study has identified multiple barriers for the implementation of these guidelines. According to our results, guideline adherence is affected by guideline factors, implementation factors, individual health professional factors, patient factors, and professional interactions, as well as by the (availability and acquisition of new) recourses and facilities and the capacity for organizational change. Reducing time pressure and workload, improving acceptance of the stop moments in urgency care, improving the IT structure, and regularly providing data and feedback regarding local benefits of the guidelines (e.g., data on reductions in complications and incidents, prevented near misses, or improved patient outcomes) are important to effectively improve the use of the perioperative safety guidelines and thereby improve perioperative patient safety. We have translated these findings into a number of recommendations that should be considered when implementing perioperative safety guidelines and are also relevant for changes in healthcare more broadly. To achieve reductions in work pressure and stress, it could be useful to make efficient alterations in the time allocation, increase staff or reconsider tasks and responsibilities, and improve IT facilities. By altering the perceived importance and perceptions about safe care and the time consumption involved in such a way that the stop moments make more sense in case of urgency, it is likely that compliance will increase. The perceived importance is strongly related to understanding the intentions and aims of the guidelines and stop moments in particular [29]. In addition, risk perception plays an important role [29]. Based on the results of this study, we suggest to give the perceived lack of applicability to emergency patients more prominent attention in implementation efforts (education and training of current staff and new employees). It is also important to focus efforts on developing methods by which the impact of the guidelines on daily performance can be captured and fed-back to staff. However, this needs a shift to a culture of intelligent data usage aimed at continuous quality and safety improvement. Data highlighting the local impact of the guidelines in terms of safer care can then be used by hospitals or disciplines to develop tailored and barrier-driven interventions to improve adherence in practice. This will also reinforce the personal relevance and interest in the guideline implementation. All this is probably what will motivate caregivers.
In conclusion, our study revealed a broad spectrum of barriers that perioperative key professionals perceive in applying a set of nationally developed perioperative safety guidelines. Implementation guidance should include explicit attention to these barriers and drivers. As a consequence, multiple interventions tailored to specific local barriers and drivers are needed to improve the use of the guidelines in practice. Results from this study help explain the suboptimal adherence in daily practice and provide useful suggestions for improving guideline adherence.
Availability of data and materials
The dataset generated and analyzed during the current study is not publicly available as no informed consent for this has been obtained from the participating hospitals and individual professionals.
Abbreviations
- GGF:
-
Green Wave Form
- ICU:
-
intensive care unit
- IGJ:
-
Inspectie Gezondheidszorg en Jeugd (Dutch Health Care Inspectorate)
- IMPROVE:
-
IMPlementatie Richtlijnen Operatieve VEiligheid (Implementation of Perioperative Safety Guidelines)
- IT:
-
Information technologies
- MIDI:
-
Measurement Instrument for Determinants of Innovations
- OR:
-
operation room
- PSIs:
-
Patient Safety Indicators
- SD:
-
Standard deviation
- TNO:
-
Dutch Organization for Applied Scientific Research
- TOP:
-
Toezicht Operatief Proces (Supervision of the Surgical Process)
- WHO:
-
World Health Organization
References
Institute of Medicine (US) Committee on Quality of Health Care in America. Crossing the Quality Chasm: A New Health System for the 21st Century. Washington (DC): National Academies Press (US); 2001.
Grol R, Baker R, Moss F. Quality improvement research: understanding the science of change in health care. Qual Saf Health Care. 2002;11:110–1.
Grol R, Grimshaw J. From best evidence to best practice: effective implementation of change in patients' care. Lancet. 2003;362:1225–30.
World Health Organization: Safe Surgery Saves Lives. 2008. http://www.who.int/patientsafety/safesurgery/en/index.html. Accessed 18 Sept 2018.
Haynes AB, Weiser TG, Berry WR, Lipsitz SR, Breizat A-HS, Dellinger EP, Herbosa T, Joseph S, Kibatala PL, Lapitan MCM, Merry AF, Moorthy K, Reznick RK, Taylor B, Gawande AA, for the Safe Surgery Saves Lives Study Group. A surgical safety checklist to reduce morbidity and mortality in a global population. N Engl J Med. 2009;360:491–9.
Semel ME, Resch S, Haynes AB, Funk LM, Bader A, Berry WR, Weiser TG, Gawande AA. Adopting a surgical safety checklist could save money and improve the quality of care in U.S. hospitals. Health Aff. 2010;29:1593–9.
Nederlandse Vereniging voor Anesthesiologie (NVA), Nederlandse Vereniging voor Heelkunde (NVvH). Richtlijn Het Preoperatieve Traject [Guideline for the Preoperative Care Process]. Utrecht: NVA/NVvH; 2010.
Nederlandse Vereniging voor Anesthesiologie (NVA), Nederlandse Vereniging voor Heelkunde (NVvH). Richtlijn Het Peroperatieve Traject [Guideline for the Peroperative Care Process]. Utrecht: NVA/NVvH; 2011.
Nederlandse Vereniging voor Anesthesiologie (NVA), Nederlandse Vereniging voor Heelkunde (NVvH). Richtlijn Het Postoperatieve Traject [Guideline for the Postoperative Care Process]. Utrecht: NVA/NVvH; 2012.
Emond YEJ, Stienen JJ, Wollersheim HC, Bloo GJ, Damen J, Westert GP, Boermeester MA, Pols MA, Calsbeek H, Wolff AP. Development and measurement of perioperative patient safety indicators. Br J Anaesth. 2005;114:963–72.
De Vries EN, Prins HA, Crolla RMPH, Den Outer AJ, Van Andel G, Van Helden SH, Schlack WS, Van Putten MA, Gouma DJ, Dijkgraaf MGW, Smorenburg SM, Boermeester MA, for the SURPASS Collaborative Group. Effect of a comprehensive surgical safety system on patient outcomes. N Engl J Med. 2010;363:1928–37.
Van Klei WA, Hoff RG, Van Aarnhem EE, Simmermacher RKJ, Regli LPE, Kappen TH, Van Wolfswinkel LM, Kalkman CJ, Buhre WF, Peelen LM. Effects of the introduction of the WHO “surgical checklist” on in-hospital mortality. Ann Surg. 2012;255:44–9.
Grimshaw J, Freemantle N, Wallace S, Russell I, Hurwitz B, Watt I, Long A, Sheldon T. Developing and implementing clinical practice guidelines. Qual Health Care. 1995;4:55–64.
Lugtenberg M, Burgers JS, Westert GP. Effects of evidence-based clinical practice guidelines on quality of care: a systematic review. Qual Saf Health Care. 2009;18:385–92.
Grimshaw JM, Russell IT. Effect of clinical guidelines on medical practice: a systematic review of rigorous evaluations. Lancet. 1993;342:1317–22.
Grol R. Improving the quality of medical care: building bridges among professional pride, payer profit, and patient satisfaction. JAMA. 2001;286:2578–85.
Grimshaw J, Eccles M, Thomas R, Maclennan G, Ramsay C, Fraser C. Toward evidence-based quality improvement. Evidence (and its limitations) of the effectiveness of guideline dissemination and implementation strategies 1966-1998. J Gen Intern Med. 2006;21:S14–20.
McGlynn EA, Asch SM, Adams J, Keesey J, Hicks J, DeCristofaro A, Kerr EA. The quality of health care delivered to adults in the United States. N Engl J Med. 2003;348:2635–45.
Cabana MD, Rand CS, Powe NR, Wu WA, Wilson MH, Abboud P-AC, Rubin HR. Why don’t physicians follow clinical practice guidelines? A framework for improvement. JAMA. 1999;282:1458–65.
Grol R. Beliefs and evidence in changing clinical practice. BMJ. 1997:418–21.
Van Sluisveld N, Zegers M, Westert G, Van der Hoeven JG, Wollersheim H. A strategy to enhance the safety and efficiency of handovers of ICU patients: study protocol of the pICUp study. Implement Sci. 2013;8:67.
Grol R, Wesing M. What drives change? Barriers to and incentives for achieving evidence-based practice. MJA. 2004;180:S57–60.
Grol R, Wensing M, Hulscher M, Eccles M. Theories on implementation of change in healthcare. In: Improving Patient Care, the Implementation of Change in Clinical Practice: Elsevier; 2005. p. 15–40.
Cahill NE, Suurdt J, Ouellette-Kuntz H, Heyland DK. Understanding adherence to guidelines in the intensive care unit: development of a comprehensive framework. JPEN J Parenter Enteral Nutr. 2010;34:616–24.
Fleuren MAH, Paulussen TGWM, Van Dommelen P, Van Buuren S. Ontwikkeling MeetInstrument voor Determinanten van Innovaties (MIDI) [Development of the Measurement Instrument for Determinants of Innovations (MIDI)]. Leiden: Dutch Organization for Applied Scientific Research (TNO); 2012.
Flottorp SA, Oxman AD, Krause J, Musila NR, Wensing M, Godycki-Cwirko M, Baker R, Eccles MP. A checklist for identifying determinants of practice: a systematic review and synthesis of frameworks and taxonomies of factors that prevent or enable improvements in healthcare professional practice. Implement Sci. 2013;8:35.
Van Sluisveld N, Oerlemans AQ, Westert G, Van der Hoeven JG, Wollersheim H, Zegers M. Barriers and facilitators to improve safety and efficiency of the ICU discharge process: a mixed methods study. BMC Health Serv Res. 2017;17:251.
Emond YEJJM, Calsbeek H, Teerenstra S, Bloo GJA, Westert GP, Damen J, Wolff AP, Wollersheim HC. Improving the implementation of perioperative safety guidelines using a multifaceted intervention approach: protocol of the IMPROVE study, a stepped wedge cluster randomized trial. Implement Sci. 2015;10:1–11.
Bergs J, Lambrechts F, Simons P, Vlayen A, Marneffe W, Hellings J, Cleemput I, Vandijck D. Barriers and facilitators related to the implementation of surgical safety checklists: a systematic review of the qualitative evidence. BMJ Qual Saf. 2015;24:776–86.
Lugtenberg M, Zegers-van Schaick JM, Westert GP, Burgers JS. Why don’t physicians adhere to guideline recommendations in practice? An analysis of barriers among Dutch general practitioners. Implement Sci. 2009;4:54.
Lugtenberg M, Burgers JS, Besters CF, Han D, Westert GP. Perceived barriers to guideline adherence: a survey among general practitioners. BMC Fam Pract. 2011;12:98.
Russ SJ, Sevdalis N, Moorthy K, Mayer EK, Rout S, Caris J, Mansell J, Davies R, Vincent C, Darzi A. A qualitative evaluation of the barriers and facilitators toward implementation of the WHO surgical safety checklist across hospitals in England. Lessons from the “surgical checklist implementation project”. Ann Surg. 2015;261:81–91.
Tunis SR, Hayward RSA, Wilson MC, Rubin HR, Bass EB, Johnston M, Steinberg EP. Internists’ attitudes about clinical practice guidelines. Ann Intern Med. 1994;120:956–63.
Farquhar CM, Kofa EW, Slutsky JR. Clinicians’ attitudes to clinical practice guidelines: a systematic review. MJA. 2002;177:502–6.
Bandura A. Social Foundations of Thought and Action: a Social Cognitive Theory. Englewood Cliffs: Prentice-Hall; 1986.
Verdaasdonk EG, Stassen LP, Widhiasmara PP, Dankelman J. Requirements for the design and implementation of checklists for surgical processes. Surg Endosc. 2009;23:715–26.
Riesenberg LA, Leitzsch J, Cunningham JM. Nursing handoffs: a systematic review of the literature. Am J Nurs. 2010;110:24–34.
Lingard L, Regeher G, Orser B, Rezncik R, Baker GR, Doran D, Espin S, Bohnen J, Whyte S. Evaluation of a perioperative checklist and team briefing among surgeons, nurses, and anesthesiologists to reduce failures in communication. Arch Surg. 2008;143:12–7.
Davies JM. Team communication in the operating room. Acta Anaesthesiol Scand. 2005;49:898–901.
Nembhard IM, Edmondson AC. Making it safe: the effects of leader inclusiveness and professional status on psychological safety and improvement efforts in health care teams. J Organiz Behav. 2006;27:941–66.
Edmondson AC. Psychological safety and learning behavior in work teams. Adm Sci Q. 1999;44:350–83.
Vats A, Vincent CA, Nagpal K, Davies RW, Darzi A, Moorthy K. Practical challenges of introducing WHO surgical checklist: UK pilot experience. BMJ. 2010;340:b5433.
Lingard L, Espin S, Rubin B, Whyte S, Colmenares M, Baker GR, Doran D, Grober E, Orser B, Bohnen J, Reznick R. Getting teams to talk: development and pilot implementation of a checklist to promote interprofessional communication in the OR. Qual Saf Health Care. 2005;14:340–6.
Böhmer AB, Wappler F, Tinschmann T, Kindermann P, Rixen D, Bellendir M, Schwanke U, Bouillon B, Gerbergshagen MU. The implementation of a perioperative checklist increases patients’ perioperative safety and staff satisfaction. Acta Anaesthesiol Scand. 2012;56:332–8.
Kellerman SE, Herold J. Physician response to surveys. AM J Prev Med. 2001;20:61–7.
Barclay S, Todd C, Finlay I, Grande G, Wyatt P. Not another questionnaire! Maximizing the response rate, predicting non-response and assessing non-response bias in postal questionnaire studies of GP’s. Fam Pract. 2002;19:105–11.
Cull WL, O’Connor KG, Sharp S, Tang SF. Response rates and response bias for 50 surveys of paediatricians. Health Serv Res. 2005;40:213–26.
Acknowledgments
The authors acknowledge the perioperative key professionals for their participation.
Funding
This study has been funded by ZonMw (project number: 71103008). The views expressed are those of the authors. The funding organization had no role in the design, implementation, interpretation, and reporting of the study.
Author information
Authors and Affiliations
Contributions
YE, AW, YP, JD, HC, and HW are responsible for the design and coordination of the study. YE and YP are responsible for the acquisition of data, data analysis, and interpretation with direct supervision and feedback from AW, JD, HC, and HW. YE wrote the first draft of the manuscript, and all co-authors revised this critically for important intellectual content. JD died in October 2018. All other authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
The study was approved by the Medical Ethical Committee of the Radboud university medical center following Dutch and European legislation (registration number: 2011/318).
The participation of hospitals in the study was voluntary.
Consent for publication
Not applicable.
Competing interests
The authors have no competing interests to declare.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary information
Additional file 1.
PSIs for the pre-, per-, and postoperative care path.
Additional file 2.
The answers on four open-ended questions.
Additional file 3.
Summary of possible differences between the different professional groups and hospital types.
Additional file 4.
The questionnaire survey.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Emond, Y.E.J.J.M., Wolff, A.P., Peters, Y.A.S. et al. Reducing work pressure and IT problems and facilitating IT integration and audit & feedback help adherence to perioperative safety guidelines: a survey among 95 perioperative professionals. Implement Sci Commun 1, 49 (2020). https://doi.org/10.1186/s43058-020-00037-1
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s43058-020-00037-1