Skip to main content

Reducing work pressure and IT problems and facilitating IT integration and audit & feedback help adherence to perioperative safety guidelines: a survey among 95 perioperative professionals

Abstract

Background

To improve perioperative patient safety, guidelines for the preoperative, peroperative, and postoperative phase were introduced in the Netherlands between 2010 and 2013. To help the implementation of these guidelines, we aimed to get a better understanding of the barriers and drivers of perioperative guideline adherence and to explore what can be learned for future implementation projects in complex organizations.

Methods

We developed a questionnaire survey based on the theoretical framework of Van Sluisveld et al. for classifying barriers and facilitators. The questionnaire contained 57 statements derived from (a) an instrument for measuring determinants of innovations by the Dutch Organization for Applied Scientific Research, (b) interviews with quality and safety policy officers and perioperative professionals, and (c) a publication of Cabana et al. The target group consisted of 232 perioperative professionals in nine hospitals. In addition to rating the statements on a five-point Likert scale (which were classified into the seven categories of the framework: factors relating to the intervention, society, implementation, organization, professional, patients, and social factors), respondents were invited to rank their three most important barriers in a separate, extra open-ended question.

Results

Ninety-five professionals (41%) completed the questionnaire. Fifteen statements (26%) were considered to be barriers, relating to social factors (N = 5), the organization (N = 4), the professional (N = 4), the patient (N = 1), and the intervention (N = 1). An integrated information system was considered an important facilitator (70.4%) as well as audit and feedback (41.8%). The Barriers Top-3 question resulted in 75 different barriers in nearly all categories. The most frequently reported barriers were as follows: time pressure (16% of the total number of barriers), emergency patients (8%), inefficient IT structure (4%), and workload (3%).

Conclusions

We identified a wide range of barriers that are believed to hinder the use of the perioperative safety guidelines, while an integrated information system and local data collection and feedback will also be necessary to engage perioperative teams. These barriers need to be locally prioritized and addressed by tailored implementation strategies. These results may also be of relevance for guideline implementation in general in complex organizations.

Trial registration

Dutch Trial Registry: NTR3568.

Peer Review reports

Background

Rising demands for efficiency, effectiveness, and safety with increasingly limited resources put healthcare systems worldwide under pressure to continuously deliver high-quality and safe care [1, 2]. It is recognized that implementation of best practices in healthcare is slow, incomplete, and often not sustainable, with variations in compliance [3].

In 2008, the World Health Organization (WHO) Surgical Safety Checklist was introduced to ensure the consistent use of safety processes [4]. The application of the WHO checklist has led to reductions in adverse events [5] and cost savings [6]. In the Netherlands, three novel guidelines with recommendations for a safe preoperative, peroperative, and postoperative care pathway including Patient Safety Indicators (PSIs) (see Additional file 1) were published [7,8,9,10]. These recommendations involve the process and organization of perioperative care, instead of the clinical content of the care process, with descriptions of responsibilities and standardization of methods to reduce risks related to—among others—handovers, wrong-site surgery, infection prevention, allergies, retained surgical clamps or sponges, and blood-clotting problems. In addition, several stop moments, i.e., stopping rules translated into a checklist, have been introduced, such as the preoperative screening, the time-out, and the sign-out, in order to check whether agreements have been met and a patient can go to the next phase in the care process (all stop moments in the perioperative trajectory have to be performed in each surgical patient). The goal of the guideline initiative is a culture that demonstrably improves perioperative outcomes by the timely administration of antibiotic prophylaxis where indicated and the performance of the entire STOP bundle (i.e., a composite outcome defined as the percentage of patients in which all the stop moments in the whole perioperative care process have been performed) in all patients.

Implementation of these perioperative safety guidelines is expected to reduce adverse patient outcomes. Several studies showed that using stop moments and the timely administration of antibiotic prophylaxis improve perioperative outcomes [5, 11, 12]. Adherence to these guidelines has, however, shown to be far from optimal [10]. These results clearly show that a thorough analysis of the barriers and drivers for adherence to the perioperative safety guidelines is essential to further improve perioperative patient safety.

One of the most consistent findings in healthcare services research is the gap between best practice on the one hand and the actual clinical care on the other. Despite the considerable efforts in developing and implementing evidence-based guidelines, only a modest impact has been found on clinical practice [13,14,15,16,17]. Producing change is usually less easy, particularly when multiple medical and paramedical disciplines are involved or the innovation requires complex changes in clinical practice, better collaboration between disciplines, or changes in the organization of care. A comprehensive study in the USA showed that only about half of the patients (55%) received recommended care as described in the guidelines [18]. In addition, it has been demonstrated that changing physicians’ behavior is extremely difficult [19]. From a psychological perspective, this is called the “knowledge-behavior gap,” indicating the difference between what we know we should do and what we actually do in clinical daily practice [3, 19]. Reflecting on this failure of implementation, most experts in healthcare improvement now emphasize the crucial importance of acquiring a good understanding of the problem, the target group, its setting, and the obstacles to change [20]. To bridge the gap between desired and current patient care, we need an in-depth understanding of the barriers and incentives to achieve change in practice. In general, little is known about the processes and factors responsible for how healthcare professionals change their practice methods when they have to adhere to a new guideline and do something they did not do before.

Many factors may influence the implementation of the perioperative safety guidelines in practice. In scientific research on determinants of change, it is important to obtain a comprehensive insight into these factors. A theoretical approach can help explain these factors and possibly help target interventions. To answer our research question and structure the analysis, we used a framework of Van Sluisveld et al. [21] that provides insight into the process of the implementation of scientific evidence, as well as into factors influencing this process. This framework is based on three models related to implementing change: the implementation of change model of Grol and Wensing [22, 23], the framework of knowledge–attitude–behavior-related barriers for guideline adherence of Cabana et al. [19], and the framework for adherence to clinical practice guidelines in the intensive care unit (ICU) of Cahill et al. [24]. Measuring determinants is thus a first and basic activity for all researchers and implementation supervisors. The Dutch Organization for Applied Scientific Research (TNO) has developed a short diagnostic tool for this [25]. The TNO has been conducting research since 1999 into determinants that predict the actual use of innovations. In 2012, the organization performed a meta-analysis to arrive at an empirically supported list of 29 determinants, which has been converted into a generic diagnostic tool: the Measurement Instrument for Determinants of Innovations (MIDI). Based on the literature [21, 23], the following seven categories of factors can be identified: features of the innovation itself (e.g., complexity, credibility, amount of information, feasibility), features of the societal context (e.g., political developments and policies, legal obligations, and regulations), features of the interventions used for implementation and dissemination (e.g., exposure to implementation efforts), features of the institutional context (e.g., organizational structure, organization of care and logistic processes, time, [qualified] staff, task divisions, [financial] resources, equipment, IT structure), features of the social setting (e.g., behavior of colleagues, collaboration, culture in the team), features of the target group of professionals who should use the innovation (e.g., their awareness, knowledge, motivation, opinions, attitudes, behavioral routines, habits, expectations), and features of the patients (e.g., their capacities, preferences) [21, 23].

Tailored and barrier-driven implementation strategies are needed to improve adherence to guidelines in practice. An adequate analysis of barriers and facilitators to the implementation of a guideline is considered to be a first and important step in improving guideline adherence and subsequently quality and safety of care [3, 20]. The barriers and facilitators identified can be used to develop tailored implementation strategies. Systematic tailoring entails (at least) three key steps: identification of the determinants of practice (i.e., barriers and facilitators), designing implementation interventions appropriate to the determinants, and application (and evaluation) of implementation interventions that are matched to the identified determinants [26]. In this study, relevant barriers and drivers for the implementation of the perioperative safety guidelines and more specifically the stop moments were explored and prioritized, aiming to offer opportunities to develop determinant-driven and tailored interventions to improve the implementation and use of the perioperative guidelines in practice. Some of the determinants will be generic (they influence many implementation processes), while others will be specific to the guidelines being implemented. We also acknowledged the role of the context in implementation. The factors that determine whether the implementation of an innovation is successful or not are many and varied. Factors may be connected to the setting in which the innovation is to be implemented. Each target group or setting is, in some sense, unique. There are often clear differences between groups of care providers and hospitals with respect to their barriers and drivers for change. Effective implementation, therefore, cannot take place without an analysis of the setting and the target group in which the implementation is to take place. We, therefore, also performed subgroup analyses as in the study of Van Sluisveld et al. [27].

Methods

Study design

An anonymous online questionnaire survey about factors that may influence the implementation of the perioperative safety guidelines was conducted among 46 anesthesiologists, 33 surgeons, 124 nurses (42 operation room (OR), 34 anesthesia, 23 recovery, and 25 ward), and 29 ICU employees in all nine hospitals enrolled in the IMPROVE (IMPlementatie Richtlijnen Operatieve VEiligheid (Implementation of Perioperative Safety Guidelines)) study [28] (two academic, four tertiary teaching, and three regional hospitals). We asked the contact persons to provide the contact data of at least one respondent per discipline. Because of the expected low respondence rates, we used an information-oriented selection strategy to maximize the utility of information from single cases or small samples. The respondents were purposively selected as key professionals by the contact persons in their hospitals on the basis of relevance (expectations about their information content). After pilot testing the questionnaire within the IMPROVE research team for comprehensibility, completeness, overlapping questions, and length, the questionnaire was sent by e-mail, followed by two reminder e-mails after 1 and 3 weeks, respectively. Informed consent was implied by completion and return of the questionnaire.

Questionnaire

The questionnaire was self-developed, based on the theoretical framework for classifying barriers and facilitators as described by Van Sluisveld et al. [21]. According to this framework, barriers and facilitators are grouped according to whether they are related to the intervention, society, implementation, organization, professional, patient, or social factors. The content was derived from the instrument for measuring determinants of innovations by TNO [25], from the publication of Cabana et al. [19] about why physicians do not follow clinical practice guidelines, and from the results of 19 individual semi-structured interviews with quality and safety policy officers and perioperative key professionals in five Dutch hospitals. These interviews were held during the development process of the PSIs belonging to the perioperative safety guidelines [28]. The interviews were audio recorded over the phone. Interviewees were asked, by means of a topic guide, about the factors that hindered or aided the guideline implementation process.

The final questionnaire covered six sections: (1) demographic and professional characteristics; (2) guideline adherence topics: the intervention characteristics, the societal context, the institutional characteristics, the social context, the professional characteristics, and the patient characteristics; (3) adherence to the stop moments; (4) local implementation; (5) prioritizing barriers into a personal top-3 list; and (6) wishes and needs with respect to the future implementation of the guidelines. Respondents were asked to score the statements on a five-point Likert scale or to answer open-ended questions on their opinions (e.g. “how can the implementation be improved?”) and ranking their three most important barriers. The professionals were also asked to score the motivation or readiness within their discipline to work or start working according to the perioperative guidelines on a 10-point scale (1 = my discipline is not motivated nor willing to work according to the perioperative guidelines and to perform the stop moments; 10 = my discipline is fully motivated and willing to work according to the perioperative guidelines and to perform the stop moments).

Data analysis

The questionnaire results were analyzed using SPSS 20. In case of incomplete surveys, we applied pairwise deletion of missing values. Thus, for each analysis, questionnaires were excluded from the analysis only if the concerning variables could not be derived from the questionnaire due to missing data in that questionnaire. Descriptive statistics were used (percentages, mean, standard deviation). We first recoded the statements that were negatively formulated to match those positively formulated (so that a higher score indicated a positive response). We then grouped the statement scores 1 and 2, indicating a negative response (disagreement with the statement), as well as the scores 4 and 5, indicating a positive response (agreement with the statement). The score 3 indicated a neutral response. We sorted the statements in a table, in which 100% was the highest (i.e., all respondents scored the statement as positive) and 0% was the lowest measure of agreement. We considered a statement to reflect a perceived barrier if fewer than 50% of the respondents scored the statement as positive (score 4 or 5).

To explore whether there were differences in answers with regard to the statements between subgroups based on discipline and hospital type, we conducted subgroup analyses, i.e., Student’s t tests with a p value < 0.05 as threshold to signal differences.

Results

Characteristics of the respondents

We received 95 completed questionnaires, resulting in a response rate of 41%. Thirty-two percent of the questionnaires were incomplete, with one or more questions missing. There was no indication that “sensitive” questions were avoided. Questionnaires were deleted from the analysis only if the required question was missing. This resulted in analyses of 93–99% of the questionnaires. The majority of the professionals were female (56%). Respondents had 18.6 ± 9.9 years (range 1–40 years) of work experience in their current function and 15.8 ± 10.7 years (range 1–42 years) of work experience in their current hospital. All respondents were contracted to only one of the included hospitals, with 80% affiliated to non-academic hospitals. Eight percent had a function other than the prespecified professions (see the “Study design” section), e.g., OR executive; operational executive; head of the OR; surgical team, OR team, or nursing ward team leader. Response was lowest among ward nurses (response rate of 20%), OR nurses (28%), and ICU employees (34%). The response of the other disciplines was > 41%. Table 1 summarizes the demographic and professional characteristics of the responding professionals.

Table 1 Demographic and professional characteristics of the responding perioperative key professionals (N = 95)

Adherence to the stop moments

Sixty-five percent of the respondents reported that the performance of the stop moments was fully integrated in the daily routines of the perioperative process within their hospital. According to 69% of the respondents, stop moments were sometimes skipped.

Perceived barriers

Fifteen of the 57 statements (26.3%) were considered to be barriers (Table 2). These had to do with the following:

  1. 1.

    Social context: Respondents did not care about the opinion of their colleagues; difficulty in bringing the entire team together to carry out a stop moment; colleagues did not always set a good example; the experience of (social) pressure to work not according to the perioperative guidelines; and the impression that their hospital has no open culture, in which everyone should dare to speak up in a social atmosphere of perceived safety

  2. 2.

    Organizational characteristics: the perception that no measures were taken by their hospital to ensure that new employees are adequately instructed in the application of the perioperative guidelines; a lack of financial resources and insufficient time to integrate the perioperative guidelines in their daily work; and no evaluation of the results of working according to the perioperative guidelines in terms of patient safety (e.g., mortality or complications)

  3. 3.

    Professional characteristics: the perception of a safety problem in their hospital; no clear opinions on the distribution of tasks and responsibilities with regard to perioperative care; the perception that working according to the guidelines takes a lot of time (delaying the workflow), which goes at the expense of production and leads to increased work pressure

  4. 4.

    Patient characteristics: respondents thought that patients did not expect them to apply the perioperative guidelines

  5. 5.

    Intervention characteristics: difficulty to adjust daily routines accordingly to the guidelines

Table 2 Results of the statements on the determinants of guideline adherence (N = 57)

Local implementation

Sixty-one percent of the respondents participated in the implementation interventions in their hospital. Reasons for not participating were: time pressure (37%); absence during the interventions (35%); no priority (19%); no obligation (11%); doubts about the added value of the interventions (8%); and colleagues did not also participate (3%).

Perceived facilitators for future implementation

On average, motivation was valued at 7.5 out of 10 (SD = 1.28; range = 4–10).

The majority of health professionals reported that integrated information systems (70.4%) and audit and feedback (41.8%) were the most useful tools to support the appliance of the perioperative guidelines and stop moments. Furthermore, approximately 37% of our respondents indicated that education would improve the implementation of the guidelines, whereas 36% indicated that they would like (digital) checklists. Thirty-three percent wished for more administrative support, and 24% requested the availability of more computers, smartphones, or tablets to fill out the checklists.

In Additional file 2, the answers to the open-ended questions are provided.

Barriers Top-3

A total of up to 75 unique barriers to effective guideline implementation were found (Table 3). Sixty-nine professionals reported at least one barrier, 54 professionals ranked at least two barriers, and 35 professionals ranked three barriers. Overall, organizational barriers were most frequently reported.

Table 3 Barriers for guideline adherence (75 unique barriers) ranked in Barriers Top-3 (N = 158 in total)

The most frequently mentioned barriers concerning the innovation itself were skepticism with regard to the perioperative safety guidelines, which were considered to lack scientific evidence and to have a complex nature (i.e., unclear and ambiguous). A barrier regarding the implementation of the guidelines was a lack of timeliness, i.e., no early exposure to the implementation efforts. Frequently mentioned organizational barriers were time pressure, IT problems and lacking IT facilities, workload, suboptimal organizational preconditions (e.g., preparations were not adequately performed), and incomplete, missing, or wrong relevant information. Two important barriers regarding the social context were cultural problems (sense of awareness, but no broad support by everyone) and a lack of collaboration (i.e., not working together as a well-coordinated team). Frequent barriers at the level of the professional were defensive and disruptive attitudes and personal opinions toward the guidelines (i.e., finding the guidelines too excessive and the opinion that adherence to the guidelines may create a wrong sense of safety by weakening independent thinking and responsibility taking), behavioral routines that require adjustment, and a lack of awareness and knowledge about the importance and purpose of the guidelines. Perceived applicability of the stop moments during urgency care was the most important barrier at the patient level.

Subgroup analyses

We found signals for possible differences in answers between perioperative key disciplines (see Additional file 3). Also, differences between types of hospital seemed to be present. For example, more respondents of peripheral hospitals than of academic or tertiary teaching hospitals seemed to think that measures are taken in their hospital to ensure that new employees are adequately instructed in the application of the perioperative guidelines. Respondents from tertiary teaching hospitals appeared to more often state to have an opinion leader/innovator within their discipline than respondents from academic or peripheral hospitals. Overall, subgroup analyses showed in 25% of the statements signals for differences between subgroups.

Discussion

This nationally representative study identified 75 barriers to the success of the implementation of the perioperative safety guidelines, relating to time constraints, time pressure in emergency procedures, insufficient IT support and facilities, experienced increased workload, non-constructive attitudes and opinions toward the guidelines, lack of clinical documentation (i.e., missing, incomplete, or wrong information), suboptimal culture, lack of awareness, and knowledge about the importance and purpose, poor teamwork, lack of scientific evidence, complexity of the guidelines, lack of exposure to implementation efforts, suboptimal organizational preconditions, and lack of motivation to change behavioral routines. Several barriers already identified [19, 27, 29,30,31,32] were confirmed; these included a lack of time, inappropriateness in certain contexts such as emergencies, insufficient awareness, resisting opinions and insufficient knowledge of the professionals, inadequate IT infrastructures, social factors such as a suboptimal culture and collaboration (i.e., teamwork issues), skepticism regarding the evidence base, and inability to overcome the inertia of previous practice. However, we were not able to find other publications relating specifically to barriers concerning perioperative guidelines. Much research has been done on other guidelines and among other disciplines such as general practitioners, but the perioperative setting is underrepresented in implementation studies. Characterization of barriers and drivers to guideline implementation in this area is still needed.

The majority of the involved healthcare professionals seemed to agree with the specific guidelines and the concept of guidelines in general. Seventy-eight percent of the respondents felt (very) positive about guidelines in general. Other studies focusing on physicians’ attitudes toward guidelines demonstrated overall positive attitudes as well [33, 34]. Seventy-six percent believed that following the perioperative guidelines improves patient safety. Outcome expectancy is the expectation that a given behavior will lead to particular consequences; if a healthcare professional believes that a recommendation will lead to improved outcomes, adherence to this recommendation is more likely [35]. Motivation to work or start working according to the perioperative guidelines was valued at 7.5 on a scale of 10. Motivation of OR team members is considered essential for compliance with checklist use [36].

Only 56% of the respondents received regular feedback about perioperative incidents and complications that took place in their hospital. This might explain why only 51% of the responding healthcare professionals thought that the effects of using the guidelines are clearly visible. Furthermore, in line with previous literature [32], 42% considered a culture of audit and feedback as an important facilitator for the use of the perioperative safety guidelines.

It was remarkable that more than half of the respondents (54%) sometimes experienced (social) pressure not to work according to the perioperative guidelines and just one third (33%) perceived the relational culture of their hospital as open. In addition, only half of the respondents (51%) thought that everyone takes their responsibility in addressing each other in unsafe situations and guideline non-adherence. These issues often stem from a hierarchical team culture that obstructs the open culture and communication required to use the guidelines correctly. In almost all cases, an overly hierarchical culture is negatively associated with implementation of quality improvement and related practices. Riesenberg et al. [37] already reported communication barriers related to social structures and hierarchies in a study on nursing handoffs. To improve the safety culture, interventions should aim at minimizing this hierarchy [29]. The use of checklists is expected to improve communication among the OR team by the reduction of hierarchy barriers and unfamiliarity [38]. In particular, introducing every single team member by name and function before incision might create an atmosphere of mutual respect and acceptance and good team communication [39]. The existing hierarchies and the differential interprofessional status accorded to those in different disciplines must be altered in order to create psychological safety. Each member has to be allowed to take interpersonal risk by speaking up if any concern about safety arises without being afraid of being embarrassed, rejected, or punished [40, 41]. Psychological safety is a key antecedent of speaking up and learning behavior in healthcare teams [40].

In line with earlier literature [42], 42% of the respondents thought it was sometimes difficult to bring the entire team together to carry out a stop moment. Also, stop moments were performed when key professionals were absent or some staff were doing tasks away from the patient. This was also confirmed by the open responses in our study: “Doctors are not always on time or busy with several things at the same time (for example, looking at a patient on the ward). In order not to hamper the process, this will continue, without paying enough attention to the time-out. Sign-out agreements are almost always not discussed by the surgeon involved. OR assistants often spend time in the sterile preparation room during the time-out, so that none of them are present.”

“It remains difficult for some doctors to complete the questionnaire point by point with the whole team. Often, this is still a kind of a private chat. We do not always wait until the team is complete. Some colleagues continue with other ‘jobs’ during ‘topping’. In my opinion this should be a moment where everyone stops with what they are doing and finishes the TOP list as a team with full attention.”

Poor use of checklists has also the potential to deepen existing cultural division and further deteriorate interprofessional dynamics. When dominant team members decide to do the checks among themselves, other members of the team may feel excluded [43].

The most commonly mentioned barrier in the Barriers Top-3 was a lack of time. This was also confirmed by the results on the relevant barrier statement: only one third of the respondents (37%) experienced sufficient time to integrate the perioperative guidelines in their daily work. Consulting patients in an emergency situation was the next common barrier: 19% of the professionals perceived the guidelines to be inappropriate for time-pressured emergencies. These two barriers as well as workload are related to each other and have to do with work pressure and stress.

Time constraints are an external barrier. This may explain the discrepancy between the relative high motivation to work or start working according to the perioperative guidelines (a score of 7.5 out of 10) and actual guideline adherence in practice [10]. The conflict between time constraints as well as economic constraints and patient safety may also lead to increased stress for the personnel and negatively influence job satisfaction [44]. However, the performance of stop moments during urgent surgical procedures is not an external barrier and is under the healthcare professionals’ control. This barrier has to do with staff attitude and personnel’s conceptions of time and patient safety. The time investment of a stop moment in case of urgency is experienced as wasted time by many healthcare professionals. However, it has never been proven that the time spent conducting the stop moments takes too long in such a situation, and the duration of an average time-out procedure (1 to 3 minutes) [unpublished observation] does not confirm this either. Moreover, stops 1 and 3 do not apply in case of urgency, but this should not affect the execution of the other stop moments in the perioperative trajectory of emergency patients. Especially in urgent interventions, the risk of errors and complications is greater. In these circumstances, the execution of the stop moments is considered even more important.

A methodological strength of this study is the basis of an existing theoretical framework from the field of implementation science [21] for the online questionnaire with supplementary open-ended questions in order to obtain open responses. In this way, we tried to avoid that the determinants examined were solely dependent on the researchers’ selection and allowed the full range of implementation determinants and experiences to be explored. Our in-depth analysis of barriers and drivers provides detailed and new information to develop multifaceted implementation strategies for improving the implementation process of the perioperative safety guidelines. To the best of our knowledge, this is the first overview of quantitative research on the barriers and facilitators regarding the implementation of the national perioperative safety guidelines (with a multicenter hospital sample). We acknowledge that much has been written about (barriers and facilitators toward) the implementation of safety interventions such as surgical safety checklists. However, we have to make a distinction here. Our study concerned barriers and drivers for the implementation of guidelines that cover the complete perioperative process. That is something else than a single intervention. Parts of these guidelines, such as the stop moments, can be translated into a single intervention as, for example, a checklist. However, our study took the implementation of the entire underlying perioperative safety guidelines into consideration. By including different perioperative key disciplines from different types and sizes of hospitals, covering a representative sample of nine hospitals with geographic spread to cover multiple regions across the Netherlands, we ensured a breadth of perspectives, increasing the generalizability of our research. This generalizability may even partly hold for other areas than the perioperative one; some of the barriers and facilitators probably do not only apply for guideline implementation in the perioperative setting, since similar barriers and drivers have been previously identified as determinants influencing the implementation of change in healthcare [19, 2730, 31]. The themes that emerged from this research probably represent the determinants that play a role in the implementation of many change initiatives in healthcare and hence present a valuable learning opportunity. Moreover, our study showed that the barriers and drivers on single safety interventions (e.g., surgical safety checklist) [29, 32] and the perioperative safety guidelines resemble each other. The response rate to the questionnaire of 41% was quite good, although we still collected opinions from a relatively small sample of perioperative healthcare professionals. Moreover, the response rate showed a skewed distribution. Anesthesiologists were somewhat overrepresented, and ward nurses were less well represented. This may, on the other hand, limit the ability to generalize our findings. Future studies would do well to aim for larger sample sizes, as the number of included hospitals was also small compared with the overall number of Dutch hospitals. Our study had several other limitations. Using a purposive, stratified sampling strategy based on relevance may have resulted in capturing the professionals with the strongest views about the guidelines and who are passionate about sharing them, meaning that we may have missed some valuable feedback from those whose opinions are less pronounced. Or those with a positive attitude toward guidelines may be overrepresented in our sample. We could not access demographic data of the non-respondents for reasons of confidentiality and were therefore unable to analyze the representativeness of our respondents. A non-response analysis could have provided more insight in this issue, but was unfortunately not feasible in the present study. Moreover, no postal addresses or telephone numbers were available to us, so we could reach respondents only via professional mail. Therefore, we were unable to increase the response rate by using additional methods to reach out to potential respondents. Non-response bias may, however, not be as crucial in health professionals’ surveys as in surveys of the general population [45]. Healthcare professionals are as a group more homogeneous regarding knowledge, training, attitudes, and behavior than the general population [45]. In previous studies analyzing non-respondents of survey research, non-response bias was suggested in research in which women, recently licensed, and younger medical specialists were more likely to respond [46, 47]. However, our study population consisted of a varied sample in terms of gender and experience. Furthermore, the reliability and validity of this non-validated survey is unknown. Replication of study results and analysis of questionnaire items is therefore warranted. Also, the perceived barriers depend on the situation-related perception of the healthcare professionals and may not accurately reflect the whole spectrum of barriers. Lastly, this analysis specified a list of barriers that were believed to influence implementation of the perioperative safety guidelines, but did not specify the interactions between them.

Implementation of new hospital processes is complex and requires careful evaluation and understanding of potential barriers and drivers. The results of this study provide input to improve the adherence to the Dutch national perioperative safety guidelines in practice. Besides, our findings may be useful to take into account in the process of updating these guidelines (to raise acceptance and implementability) as well as in the development and updates of other guidelines that need to be implemented in complex and high-risk environments in healthcare. These study results also emphasize that the implementation context (different hospital types and disciplines) seems to play some, but no overarching role in the identification of barriers toward the implementation of the perioperative safety guidelines.

The majority of health professionals in this study considered the presence of integrated information systems and audit and feedback as useful tools to support the use of the perioperative guidelines and stop moments. The implementation process of the perioperative guidelines could be enhanced by hospitals stimulating a culture of regularly feeding-back local data and results, in order to create learning experiences and insights in the effects of the guidelines. The regular provision of data and feedback would significantly increase buying into an intervention, particularly for those doubting its relevance, as reported by a qualitative evaluation of the barriers and facilitators to the implementation of the WHO surgical safety checklist across hospitals in England [32]. Therefore, it is important to focus on developing methods by which information on the impact of the guidelines can be captured, fed-back, and discussed periodically. Not doing so ultimately jeopardizes buy-in.

Future research should focus on identifying barriers at the recommendation level. For now, we only looked at the barriers that apply to the overall implementation process of the guidelines, not to individual guideline recommendations. A detailed analysis of the individual guideline recommendations may help in deciding where to focus the implementation efforts. Also, substantial improvements can be achieved by focusing on the barriers that are widely applicable across recommendations.

Conclusions

The national perioperative safety guidelines were a safety improvement initiative required to be implemented in all Dutch hospitals. This study has identified multiple barriers for the implementation of these guidelines. According to our results, guideline adherence is affected by guideline factors, implementation factors, individual health professional factors, patient factors, and professional interactions, as well as by the (availability and acquisition of new) recourses and facilities and the capacity for organizational change. Reducing time pressure and workload, improving acceptance of the stop moments in urgency care, improving the IT structure, and regularly providing data and feedback regarding local benefits of the guidelines (e.g., data on reductions in complications and incidents, prevented near misses, or improved patient outcomes) are important to effectively improve the use of the perioperative safety guidelines and thereby improve perioperative patient safety. We have translated these findings into a number of recommendations that should be considered when implementing perioperative safety guidelines and are also relevant for changes in healthcare more broadly. To achieve reductions in work pressure and stress, it could be useful to make efficient alterations in the time allocation, increase staff or reconsider tasks and responsibilities, and improve IT facilities. By altering the perceived importance and perceptions about safe care and the time consumption involved in such a way that the stop moments make more sense in case of urgency, it is likely that compliance will increase. The perceived importance is strongly related to understanding the intentions and aims of the guidelines and stop moments in particular [29]. In addition, risk perception plays an important role [29]. Based on the results of this study, we suggest to give the perceived lack of applicability to emergency patients more prominent attention in implementation efforts (education and training of current staff and new employees). It is also important to focus efforts on developing methods by which the impact of the guidelines on daily performance can be captured and fed-back to staff. However, this needs a shift to a culture of intelligent data usage aimed at continuous quality and safety improvement. Data highlighting the local impact of the guidelines in terms of safer care can then be used by hospitals or disciplines to develop tailored and barrier-driven interventions to improve adherence in practice. This will also reinforce the personal relevance and interest in the guideline implementation. All this is probably what will motivate caregivers.

In conclusion, our study revealed a broad spectrum of barriers that perioperative key professionals perceive in applying a set of nationally developed perioperative safety guidelines. Implementation guidance should include explicit attention to these barriers and drivers. As a consequence, multiple interventions tailored to specific local barriers and drivers are needed to improve the use of the guidelines in practice. Results from this study help explain the suboptimal adherence in daily practice and provide useful suggestions for improving guideline adherence.

Availability of data and materials

The dataset generated and analyzed during the current study is not publicly available as no informed consent for this has been obtained from the participating hospitals and individual professionals.

Abbreviations

GGF:

Green Wave Form

ICU:

intensive care unit

IGJ:

Inspectie Gezondheidszorg en Jeugd (Dutch Health Care Inspectorate)

IMPROVE:

IMPlementatie Richtlijnen Operatieve VEiligheid (Implementation of Perioperative Safety Guidelines)

IT:

Information technologies

MIDI:

Measurement Instrument for Determinants of Innovations

OR:

operation room

PSIs:

Patient Safety Indicators

SD:

Standard deviation

TNO:

Dutch Organization for Applied Scientific Research

TOP:

Toezicht Operatief Proces (Supervision of the Surgical Process)

WHO:

World Health Organization

References

  1. Institute of Medicine (US) Committee on Quality of Health Care in America. Crossing the Quality Chasm: A New Health System for the 21st Century. Washington (DC): National Academies Press (US); 2001.

    Google Scholar 

  2. Grol R, Baker R, Moss F. Quality improvement research: understanding the science of change in health care. Qual Saf Health Care. 2002;11:110–1.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  3. Grol R, Grimshaw J. From best evidence to best practice: effective implementation of change in patients' care. Lancet. 2003;362:1225–30.

    Article  PubMed  Google Scholar 

  4. World Health Organization: Safe Surgery Saves Lives. 2008. http://www.who.int/patientsafety/safesurgery/en/index.html. Accessed 18 Sept 2018.

  5. Haynes AB, Weiser TG, Berry WR, Lipsitz SR, Breizat A-HS, Dellinger EP, Herbosa T, Joseph S, Kibatala PL, Lapitan MCM, Merry AF, Moorthy K, Reznick RK, Taylor B, Gawande AA, for the Safe Surgery Saves Lives Study Group. A surgical safety checklist to reduce morbidity and mortality in a global population. N Engl J Med. 2009;360:491–9.

    Article  CAS  PubMed  Google Scholar 

  6. Semel ME, Resch S, Haynes AB, Funk LM, Bader A, Berry WR, Weiser TG, Gawande AA. Adopting a surgical safety checklist could save money and improve the quality of care in U.S. hospitals. Health Aff. 2010;29:1593–9.

    Article  Google Scholar 

  7. Nederlandse Vereniging voor Anesthesiologie (NVA), Nederlandse Vereniging voor Heelkunde (NVvH). Richtlijn Het Preoperatieve Traject [Guideline for the Preoperative Care Process]. Utrecht: NVA/NVvH; 2010.

    Google Scholar 

  8. Nederlandse Vereniging voor Anesthesiologie (NVA), Nederlandse Vereniging voor Heelkunde (NVvH). Richtlijn Het Peroperatieve Traject [Guideline for the Peroperative Care Process]. Utrecht: NVA/NVvH; 2011.

    Google Scholar 

  9. Nederlandse Vereniging voor Anesthesiologie (NVA), Nederlandse Vereniging voor Heelkunde (NVvH). Richtlijn Het Postoperatieve Traject [Guideline for the Postoperative Care Process]. Utrecht: NVA/NVvH; 2012.

    Google Scholar 

  10. Emond YEJ, Stienen JJ, Wollersheim HC, Bloo GJ, Damen J, Westert GP, Boermeester MA, Pols MA, Calsbeek H, Wolff AP. Development and measurement of perioperative patient safety indicators. Br J Anaesth. 2005;114:963–72.

    Article  Google Scholar 

  11. De Vries EN, Prins HA, Crolla RMPH, Den Outer AJ, Van Andel G, Van Helden SH, Schlack WS, Van Putten MA, Gouma DJ, Dijkgraaf MGW, Smorenburg SM, Boermeester MA, for the SURPASS Collaborative Group. Effect of a comprehensive surgical safety system on patient outcomes. N Engl J Med. 2010;363:1928–37.

    Article  PubMed  Google Scholar 

  12. Van Klei WA, Hoff RG, Van Aarnhem EE, Simmermacher RKJ, Regli LPE, Kappen TH, Van Wolfswinkel LM, Kalkman CJ, Buhre WF, Peelen LM. Effects of the introduction of the WHO “surgical checklist” on in-hospital mortality. Ann Surg. 2012;255:44–9.

    Article  PubMed  Google Scholar 

  13. Grimshaw J, Freemantle N, Wallace S, Russell I, Hurwitz B, Watt I, Long A, Sheldon T. Developing and implementing clinical practice guidelines. Qual Health Care. 1995;4:55–64.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  14. Lugtenberg M, Burgers JS, Westert GP. Effects of evidence-based clinical practice guidelines on quality of care: a systematic review. Qual Saf Health Care. 2009;18:385–92.

    Article  CAS  PubMed  Google Scholar 

  15. Grimshaw JM, Russell IT. Effect of clinical guidelines on medical practice: a systematic review of rigorous evaluations. Lancet. 1993;342:1317–22.

    Article  CAS  PubMed  Google Scholar 

  16. Grol R. Improving the quality of medical care: building bridges among professional pride, payer profit, and patient satisfaction. JAMA. 2001;286:2578–85.

    Article  CAS  PubMed  Google Scholar 

  17. Grimshaw J, Eccles M, Thomas R, Maclennan G, Ramsay C, Fraser C. Toward evidence-based quality improvement. Evidence (and its limitations) of the effectiveness of guideline dissemination and implementation strategies 1966-1998. J Gen Intern Med. 2006;21:S14–20.

    PubMed  PubMed Central  Google Scholar 

  18. McGlynn EA, Asch SM, Adams J, Keesey J, Hicks J, DeCristofaro A, Kerr EA. The quality of health care delivered to adults in the United States. N Engl J Med. 2003;348:2635–45.

    Article  PubMed  Google Scholar 

  19. Cabana MD, Rand CS, Powe NR, Wu WA, Wilson MH, Abboud P-AC, Rubin HR. Why don’t physicians follow clinical practice guidelines? A framework for improvement. JAMA. 1999;282:1458–65.

    Article  CAS  PubMed  Google Scholar 

  20. Grol R. Beliefs and evidence in changing clinical practice. BMJ. 1997:418–21.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  21. Van Sluisveld N, Zegers M, Westert G, Van der Hoeven JG, Wollersheim H. A strategy to enhance the safety and efficiency of handovers of ICU patients: study protocol of the pICUp study. Implement Sci. 2013;8:67.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Grol R, Wesing M. What drives change? Barriers to and incentives for achieving evidence-based practice. MJA. 2004;180:S57–60.

    PubMed  Google Scholar 

  23. Grol R, Wensing M, Hulscher M, Eccles M. Theories on implementation of change in healthcare. In: Improving Patient Care, the Implementation of Change in Clinical Practice: Elsevier; 2005. p. 15–40.

  24. Cahill NE, Suurdt J, Ouellette-Kuntz H, Heyland DK. Understanding adherence to guidelines in the intensive care unit: development of a comprehensive framework. JPEN J Parenter Enteral Nutr. 2010;34:616–24.

    Article  PubMed  Google Scholar 

  25. Fleuren MAH, Paulussen TGWM, Van Dommelen P, Van Buuren S. Ontwikkeling MeetInstrument voor Determinanten van Innovaties (MIDI) [Development of the Measurement Instrument for Determinants of Innovations (MIDI)]. Leiden: Dutch Organization for Applied Scientific Research (TNO); 2012.

    Google Scholar 

  26. Flottorp SA, Oxman AD, Krause J, Musila NR, Wensing M, Godycki-Cwirko M, Baker R, Eccles MP. A checklist for identifying determinants of practice: a systematic review and synthesis of frameworks and taxonomies of factors that prevent or enable improvements in healthcare professional practice. Implement Sci. 2013;8:35.

    Article  PubMed  PubMed Central  Google Scholar 

  27. Van Sluisveld N, Oerlemans AQ, Westert G, Van der Hoeven JG, Wollersheim H, Zegers M. Barriers and facilitators to improve safety and efficiency of the ICU discharge process: a mixed methods study. BMC Health Serv Res. 2017;17:251.

    Article  PubMed  PubMed Central  Google Scholar 

  28. Emond YEJJM, Calsbeek H, Teerenstra S, Bloo GJA, Westert GP, Damen J, Wolff AP, Wollersheim HC. Improving the implementation of perioperative safety guidelines using a multifaceted intervention approach: protocol of the IMPROVE study, a stepped wedge cluster randomized trial. Implement Sci. 2015;10:1–11.

    Article  Google Scholar 

  29. Bergs J, Lambrechts F, Simons P, Vlayen A, Marneffe W, Hellings J, Cleemput I, Vandijck D. Barriers and facilitators related to the implementation of surgical safety checklists: a systematic review of the qualitative evidence. BMJ Qual Saf. 2015;24:776–86.

    Article  PubMed  Google Scholar 

  30. Lugtenberg M, Zegers-van Schaick JM, Westert GP, Burgers JS. Why don’t physicians adhere to guideline recommendations in practice? An analysis of barriers among Dutch general practitioners. Implement Sci. 2009;4:54.

    Article  PubMed  PubMed Central  Google Scholar 

  31. Lugtenberg M, Burgers JS, Besters CF, Han D, Westert GP. Perceived barriers to guideline adherence: a survey among general practitioners. BMC Fam Pract. 2011;12:98.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Russ SJ, Sevdalis N, Moorthy K, Mayer EK, Rout S, Caris J, Mansell J, Davies R, Vincent C, Darzi A. A qualitative evaluation of the barriers and facilitators toward implementation of the WHO surgical safety checklist across hospitals in England. Lessons from the “surgical checklist implementation project”. Ann Surg. 2015;261:81–91.

    Article  PubMed  Google Scholar 

  33. Tunis SR, Hayward RSA, Wilson MC, Rubin HR, Bass EB, Johnston M, Steinberg EP. Internists’ attitudes about clinical practice guidelines. Ann Intern Med. 1994;120:956–63.

    Article  CAS  PubMed  Google Scholar 

  34. Farquhar CM, Kofa EW, Slutsky JR. Clinicians’ attitudes to clinical practice guidelines: a systematic review. MJA. 2002;177:502–6.

    PubMed  Google Scholar 

  35. Bandura A. Social Foundations of Thought and Action: a Social Cognitive Theory. Englewood Cliffs: Prentice-Hall; 1986.

    Google Scholar 

  36. Verdaasdonk EG, Stassen LP, Widhiasmara PP, Dankelman J. Requirements for the design and implementation of checklists for surgical processes. Surg Endosc. 2009;23:715–26.

    Article  CAS  PubMed  Google Scholar 

  37. Riesenberg LA, Leitzsch J, Cunningham JM. Nursing handoffs: a systematic review of the literature. Am J Nurs. 2010;110:24–34.

    Article  PubMed  Google Scholar 

  38. Lingard L, Regeher G, Orser B, Rezncik R, Baker GR, Doran D, Espin S, Bohnen J, Whyte S. Evaluation of a perioperative checklist and team briefing among surgeons, nurses, and anesthesiologists to reduce failures in communication. Arch Surg. 2008;143:12–7.

    Article  PubMed  Google Scholar 

  39. Davies JM. Team communication in the operating room. Acta Anaesthesiol Scand. 2005;49:898–901.

    Article  CAS  PubMed  Google Scholar 

  40. Nembhard IM, Edmondson AC. Making it safe: the effects of leader inclusiveness and professional status on psychological safety and improvement efforts in health care teams. J Organiz Behav. 2006;27:941–66.

    Article  Google Scholar 

  41. Edmondson AC. Psychological safety and learning behavior in work teams. Adm Sci Q. 1999;44:350–83.

    Article  Google Scholar 

  42. Vats A, Vincent CA, Nagpal K, Davies RW, Darzi A, Moorthy K. Practical challenges of introducing WHO surgical checklist: UK pilot experience. BMJ. 2010;340:b5433.

    Article  CAS  PubMed  Google Scholar 

  43. Lingard L, Espin S, Rubin B, Whyte S, Colmenares M, Baker GR, Doran D, Grober E, Orser B, Bohnen J, Reznick R. Getting teams to talk: development and pilot implementation of a checklist to promote interprofessional communication in the OR. Qual Saf Health Care. 2005;14:340–6.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  44. Böhmer AB, Wappler F, Tinschmann T, Kindermann P, Rixen D, Bellendir M, Schwanke U, Bouillon B, Gerbergshagen MU. The implementation of a perioperative checklist increases patients’ perioperative safety and staff satisfaction. Acta Anaesthesiol Scand. 2012;56:332–8.

    Article  PubMed  Google Scholar 

  45. Kellerman SE, Herold J. Physician response to surveys. AM J Prev Med. 2001;20:61–7.

    Article  CAS  PubMed  Google Scholar 

  46. Barclay S, Todd C, Finlay I, Grande G, Wyatt P. Not another questionnaire! Maximizing the response rate, predicting non-response and assessing non-response bias in postal questionnaire studies of GP’s. Fam Pract. 2002;19:105–11.

    Article  PubMed  Google Scholar 

  47. Cull WL, O’Connor KG, Sharp S, Tang SF. Response rates and response bias for 50 surveys of paediatricians. Health Serv Res. 2005;40:213–26.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgments

The authors acknowledge the perioperative key professionals for their participation.

Funding

This study has been funded by ZonMw (project number: 71103008). The views expressed are those of the authors. The funding organization had no role in the design, implementation, interpretation, and reporting of the study.

Author information

Authors and Affiliations

Authors

Contributions

YE, AW, YP, JD, HC, and HW are responsible for the design and coordination of the study. YE and YP are responsible for the acquisition of data, data analysis, and interpretation with direct supervision and feedback from AW, JD, HC, and HW. YE wrote the first draft of the manuscript, and all co-authors revised this critically for important intellectual content. JD died in October 2018. All other authors read and approved the final manuscript.

Corresponding author

Correspondence to Yvette E. J. J. M. Emond.

Ethics declarations

Ethics approval and consent to participate

The study was approved by the Medical Ethical Committee of the Radboud university medical center following Dutch and European legislation (registration number: 2011/318).

The participation of hospitals in the study was voluntary.

Consent for publication

Not applicable.

Competing interests

The authors have no competing interests to declare.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Additional file 1.

PSIs for the pre-, per-, and postoperative care path.

Additional file 2.

The answers on four open-ended questions.

Additional file 3.

Summary of possible differences between the different professional groups and hospital types.

Additional file 4.

The questionnaire survey.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Emond, Y.E.J.J.M., Wolff, A.P., Peters, Y.A.S. et al. Reducing work pressure and IT problems and facilitating IT integration and audit & feedback help adherence to perioperative safety guidelines: a survey among 95 perioperative professionals. Implement Sci Commun 1, 49 (2020). https://doi.org/10.1186/s43058-020-00037-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s43058-020-00037-1

Keywords