Skip to main content
Download PDF
Download ePub
  • Systematic review
  • Open access
  • Published:

Effectiveness of de-implementation strategies for low-value prescribing in secondary care: a systematic review

Implementation Science Communications volume 4, Article number: 115 (2023) Cite this article

Abstract

Background/aims

Considerable efforts have been made to improve guideline adherence in healthcare through de-implementation, such as decreasing the prescription of inappropriate medicines. However, we have limited knowledge about the effectiveness, barriers, facilitators and consequences of de-implementation strategies targeting inappropriate medication prescribing in secondary care settings. This review was conducted to understand these factors to contribute to better replication and optimisation of future de-implementation efforts to reduce low-value care.

Methods

A systematic review of randomised control trials was conducted. Papers were identified through CINAHL, EMBASE, MEDLINE and Cochrane register of controlled trials to February 2021. Eligible studies were randomised control trials evaluating behavioural strategies to de-implement inappropriate prescribing in secondary healthcare. Risk of bias was assessed using the Cochrane Risk of Bias tool. Intervention characteristics, effectiveness, barriers, facilitators and consequences were identified in the study text and tabulated.

Results

Eleven studies were included, of which seven were reported as effectively de-implementing low-value prescribing. Included studies were judged to be mainly at low to moderate risk for selection biases and generally high risk for performance and reporting biases. The majority of these strategies were clinical decision support at the ‘point of care’. Clinical decision support tools were the most common and effective. They were found to be a low-cost and simple strategy. However, barriers such as clinician’s reluctance to accept recommendations, or the clinical setting were potential barriers to their success. Educational strategies were the second most reported intervention type however the utility of educational strategies for de-implementation remains varied. Multiple barriers and facilitators relating to the environmental context, resources and knowledge were identified across studies as potentially influencing de-implementation. Various consequences were identified; however, few measured the impact of de-implementation on usual appropriate practice.

Conclusion

This review offers insight into the intervention strategies, potential barriers, facilitators and consequences that may affect the de-implementation of low-value prescribing in secondary care. Identification of these key features helps understand how and why these strategies are effective and the wider (desirable or undesirable) impact of de-implementation. These findings can contribute to the successful replication or optimisation of strategies used to de-implement low-value prescribing practices in future.

Trial registration

The review protocol was registered at PROSPERO (ID: CRD42021243944).

Peer Review reports

Background

Overuse of healthcare resources is a global issue and prescription of unnecessary medication is a key contributor to this [1]. Overprescribing of medication is defined by the UK Department of Health and Social care as medication that is not required or wanted, or where risk outweighs benefit [2]. Overprescribing is considered a ‘low-value’ practice, i.e. a practice that is not clinically [1] or cost-effective [3]. Despite efforts to encourage evidence-based practice and reduce low-value prescribing [4], healthcare professionals continue to prescribe unnecessary medication [5, 6]. To maintain a high standard of care, efficient use of resources, and to reduce potential harm to patients [1], it is important to eliminate low-value prescribing practices.

The process of eliminating ineffective or potentially harmful prescriptions can be conceptualised as ‘de-implementation’. De-implementation is not a well-defined concept and definitions vary between “abandonment of … practices” [7], or as any effort to “reduce” a practice or “address overuse” [8, 9]. In a scoping review, Niven and colleagues (2015), identified 43 terms in literature synonymous to de-implementation including “re-invest”, “discontinue” and “decline in use” [10]. Generally, these terms can fall into four types of de-implementation; removing, replacing, reducing or restricting a practice or treatment [11].

Although de-implementation has been conceptualised as the removal or reduction of a medical practice, it cannot be considered the opposite to implementation (i.e. the integration or increase) of a practice [7, 12]. The evidence base has highlighted that de-implementation is distinct from implementation [13,14,15]. Specific conceptual models for de-implementation have been developed to guide research [7, 10, 11, 16, 17] by highlighting areas for further exploration. Key features of barriers, facilitators, the type of target action, the intervention strategies and, the definition and measurement of outcomes of de-implementation have been highlighted as likely areas to differ from implementation. Further, the implications or consequences arising from achieving successful de-implementation outcomes were highlighted as another key area likely to differ from implementation [18].

Understanding the consequential effects of removing an established medical practice is crucial to evaluate de-implementation efforts [19, 20] and gain a comprehensive understanding of the full impact of de-implementation [18]. In a recent review of the consequences experienced in strategies used to reduce antibiotic prescribing, expected ‘trade-offs,’ such as an increased hospital stay, were viewed as a reasonable compromise for a successful de-implementation outcome [21]. However, unintended consequences, such as clinicians increasing their use of other medical practices to replace the practice being discontinued, may have possibly harmful repercussions [18], in addition to contradicting the process of de-implementation [21]. A fuller understanding of the nuanced impact of de-implementation alongside successful strategies and determinants will offer information to contribute to the growing evidence base which will aid better replication and optimisation of future de-implementation.

While implementation and de-implementation have been conceptualised as unique, implementation science offers a strong foundation to understand de-implementation [22, 23]. Existing implementation theory and methods have been utilised in de-implementation research considerably [24]. Frameworks such as the Theoretical Domains Framework (TDF) [25] have been applied to offer insight into de-implementation [26,27,28,29]. Most recently, the TDF has been successfully used in a multi-method study to identify barriers and facilitators of de-implementing of multiple low-value care practices in a critical care setting [30]. Parsons Leigh and colleagues successfully mapped findings from their systematic review and interview study to the TDF which provided a structured theoretical lens on important determinants of de-implementation in this setting. These existing approaches have also been used to understand the determinants of low-value prescribing behaviour, allow cumulative contributions to the expanding de-implementation evidence base and offer tangible information that can be used in future strategies [19].

Therefore, the aim of this study is to further understand the key features of de-implementation strategies aiming to reduce low-value prescribing. The insights of these efforts will contribute to better replication and optimisation of future de-implementation efforts. We used a systematic review approach to synthesise relevant literature.

Review questions

This systematic review aimed to answer these questions:

  1. (1)

    What strategies have been used to de-implement low-value prescribing practices of secondary healthcare prescribers, and how effective were these strategies?

  2. (2)

    What are the reported barriers, facilitators and unintended consequences of these strategies?

Review methods

Design

Protocol registration

This systematic review is reported following the Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) statement (Additional file 1). The protocol was registered at PROSPERO (ID: CRD42021243944).

Identification of studies

Studies were identified by searching CINAHL, EMBASE, MEDLINE and Cochrane register of controlled trials databases from inception to February 2021.

Search

A search strategy was developed with an Information Officer. The search was designed to identify randomised control trials (RCTs) evaluating behaviour change strategies to address a low-value or unnecessary medication prescriptions, within a secondary healthcare setting. De-implementation-related terms identified in a scoping review were the basis of this search strategy [10]. See the full search strategy in Table 1; the searches were adapted to the vocabulary and syntax of each database.

Table 1 Search strategy for MEDLINE
Full size table

Study selection (inclusion and exclusion criteria)

Inclusion and exclusion criteria were developed following the PICO (Population, Intervention, Context and Outcome) structure (Table 2). Eligible studies were RCTs comparing behavioural strategies to a control or other strategies. Studies had to include an intervention designed to reduce, remove, restrict or replace low-value medication prescription practice. Only studies reported in English were included. Studies had to target the initial prescribing part of the care process, rather than, at the time of review or reconciliation of medication. Prescribing here refers only to the prescription of medication, as opposed to prescribing or ordering tests or procedures. One author (JD) screened 100% of the title and abstracts, and 10% of these were independently double screened by a second author (SM). Double screening of titles and abstracts yielded a kappa score of 0.39, which is considered ‘fair’ agreement [31]. One author (JD) screened 100% of full-text articles, and 40% were independently double screened by a second author (SM).

Table 2 Inclusion and exclusion criteria
Full size table

Data extraction and coding

A bespoke data extraction form was developed and a priori headings were selected to gather data on the unique complexities of de-implementation guided by Norton and Chambers conceptual de-implementation framework [11, 18]. Headings included target actions, intervention strategies, barriers, facilitators, outcomes and consequences. Data was extracted verbatim where possible.

To allow comparisons, strategies were categorised using the Effective Practice and Organisation of Care Taxonomy (EPOC) [32]. The EPOC taxonomy offers a classification of health system interventions, including an overarching description category and subcategories of interventional strategies. All studies were allocated to overarching categories and relevant subcategories. Where appropriate, multifaceted strategies were categorised into multiple relevant subcategories.

Barriers and facilitators were the interpretation of the trial results as offered by the authors of the studies. Barriers were defined as any intrinsic or extrinsic influences faced by prescribers mentioned in the article text that may have hindered the de-implementation of low-value prescribing. Facilitators were defined as any intrinsic or extrinsic influences that may have enabled intervention success. Verbatim text of identified barriers and facilitators were summarised and mapped to the Theoretical Domains Framework (TDF) [25].

The TDF is a synthesis of 33 behavioural theories into 14 theoretical domains [25]: Behavioural Regulation, Knowledge, Skills, Beliefs about Capabilities, Beliefs about Consequences, Intentions, Reinforcement, Goals, Memory, Attention and Decision Processes, Environmental Context and Resources, Social Influences, Optimism, Emotions, and Social/Professional Role and Identity. The TDF is a theory-based tool that allows the categorisation of barriers and facilitators to understand key influences on a target behaviour.

Consequences were defined as repercussions arising from the implementation of the intervention. The diffusion of innovations literature provides a classification of consequences [33]. The framework suggested by Toma and colleagues was used to specify four classifications of consequences, including expected outcomes, which can be classed as either (1) desirable or (2) undesirable, and unexpected outcomes, which can also be (3) desirable or (4) undesirable [21]. Secondary outcomes, other planned or unplanned analyses and the study authors’ interpretations in the article text of potential consequences were extracted verbatim and categorised to these headings.

Data synthesis

We did not conduct a meta-analysis due to study heterogeneity in several factors of the included studies including variety in intervention strategies, the target illness and medication. Data was tabulated into evidence tables: (1) characteristics of included studies; (2) strategies within each study classified by the EPOC taxonomy; (3) reported intervention descriptions and their effects; (4) identified barriers to de-implementation categorised to the TDF; (6) identified facilitators of de-implementation categorised to the TDF; (7) identified consequences of de-implementation specified with Toma and colleagues framework.

Quality assessment

The risk of bias was assessed by one reviewer (JD) and a 10% sample was independently assessed by a second reviewer (SM). The tool recommended for assessing the risk of bias in RCTs outlined in the Cochrane Handbook for Systematic Reviews of Strategies [34] was used. Risk of bias arising from the randomisation process, timing of recruitment of participants (in cluster-randomised trials), deviations from the intended interventions, missing outcome data, measurement of the outcome and selection of the reported result were assessed. Disagreements were resolved by discussion within our research team.

Results of the review

Details of included and excluded studies

The database search returned 2907 titles and abstracts. Following the removal of duplicates, 2193 records remained. Thirty-two full-text articles were screened for eligibility. Eleven studies were included in this review. See the PRISMA flow diagram in Fig. 1. Main reasons for exclusion at the full text reviewing stage, included non-RCT study designs, the setting of the study was not in secondary care, and where it was unclear if the study had a de-implementation focus.

Fig. 1
figure 1

PRISMA flow diagram

Full size image

Included study characteristics

Study characteristics for the 11 included studies can be found in Table 3. Eight studies compared their strategies to a usual care comparator group [35,36,37,38,39,40,41,42] and three studies offered a partial or adapted intervention [43,44,45] as their comparator. Seven studies were cluster RCTs [36, 37, 39, 43,44,45], including one stepped wedge [42]. Two interventions included strategies targeting both the healthcare professional and the patient [37, 45]. See additional file 2 for verbatim intervention and comparison arm names, descriptions and counts.

Table 3 Characteristics of included studies
Full size table

The type of de-implementation as “reducing” low-value prescribing was identified in all studies except one. The majority of studies were conducted in high-income countries [35, 37,38,39,40,41,42,43, 45], and two took place in Kenya [36, 44]. Studies were set in emergency departments or urgent care units [37, 40,41,42, 45], other ward types [38, 39, 43] or whole hospitals [35, 36, 44]. The type of low-value prescribing being targeted tended to be inappropriate antibiotics for a range of illnesses [35, 37, 39, 42, 44, 45]; however, general inappropriate drug prescriptions, especially in the elderly, were also reported [40, 43].

The 11 studies reported 11 intervention arms. Table 4 shows classifications of intervention arms to the Effective Practice and Organisation of Care (EPOC) Taxonomy [32]. The overarching categories of ‘Implementation Strategies, Interventions targeted at healthcare workers’ and ‘Financial Arrangements, Targeted financial incentives for health professionals and healthcare organisations’ were identified. Four interventions were multi-faceted with between 4 and 8 subcategories identified. ‘Educational materials’ and ‘Audit and Feedback’ were the most used strategies in these multifaceted interventions [37, 43,44,45]. Seven interventions were single strategy, six were described as ‘reminders’ [35, 38,39,40,41,42] and one study was classified as ‘pay for performance’ [36]. Reminders were the most commonly used strategies (n = 6), educational strategies including educational meetings and educational materials were the second most common (n = 4).

Table 4 Classifications of included de-implementation interventions to the Effective Practice and Organisation of Care Taxonomy (EPOC) categories and subcategories
Full size table

Studies with an active comparator used adapted versions of the strategies employed in the intervention arm, for example, Franchie and colleagues provided educational materials in both arms, but limited the control arm to selected modules [43].

Quality assessment of studies

Risk of bias results for studies can be seen in Fig. 2. Six studies were considered to have an overall high risk of bias [35,36,37, 41, 42, 44] and five had a moderate risk of bias [38,39,40, 43, 45]. No studies were found to have an overall low risk of bias. Generally, studies tended to perform well on biases relating to the randomisation process and missing data management. However, deviating from the intended intervention domain presented the most risk of bias, as three studies had high [36, 37, 41] and four moderate risk [38, 39, 44, 45] for this domain. It should be noted that those assigned high risk for this domain tended to suffer risk of bias due to participants being aware of their participation in the trial or the allocation of the intervention, rather than deviations from intervention strategies that may have arisen from the context. Six studies were assessed as having a moderate risk of bias in the domain of selection of reported results [37, 39,40,41, 43, 44], which was mainly due to the majority of studies not referring to a published protocol.

Fig. 2
figure 2

Forest plot illustrating raw data and unadjusted differences

Full size image

Intervention effectiveness

The main aims of the included studies were to assess the effectiveness of de-implementation strategies (e.g. evaluate the effectiveness of a clinical decision support system to reduce inappropriate antibiotic prescribing in children admitted to hospital). Table 5 shows the intervention type and where studies were found effective. Seven studies reported strategies being effective in reducing low-value prescribing [35,36,37,38,39,40,41] of these, four studies were of high risk of bias [35,36,37, 41] and three were moderate risk [38,39,40]. One study reported weak evidence of an intervention effect, after adjusting for patient, clinician level factors and study period [44]. The remaining three strategies did not show any differences across arms in de-implementing inappropriate prescribing [42, 43, 45]. Additional file 3 shows the verbatim outcome definitions and results for each study.

Table 5 Intervention description, type and reported effectiveness
Full size table

The most reported effective strategies were classed as ‘reminders’, offered at the point of care [35, 38,39,40,41,42]. Reminders are defined by the EPOC Taxonomy [32] as any intervention that prompts action, such as decision support aids. Although in varying formats, ‘reminders’ were single-strategy clinical decision support systems. These decision support systems varied as some offered thresholds to guide appropriate prescribing decisions [42], accounted for or restricted additional diagnostic information [35, 39] or provided recommendations of appropriate substitutes [38, 40, 41]. These strategies were offered in emergency and non-emergency settings; however, the use of clinical decision support systems was exclusive to high-income countries. Educational strategies, including educational materials and meetings, were the second most common. However, only one of four studies using educational strategies was found to be effective [37].

Eight studies reported outcomes as ‘inappropriate’ prescribing behaviour (i.e. measured the number of unnecessary prescriptions) and three reported outcomes as ‘appropriate’ (i.e. measured the amount of necessary prescriptions), data and calculated odds ratios are presented in the forest plot in Fig. 2 for comparison. Where data was not available or easily extracted, study authors were contacted. Menya et al. (2015) and Yadav et al. (2019) were unable to offer complete data.

Barriers and facilitators of de-implementation

Barriers

Only one study proactively identified potential barriers, of alert fatigue and unimportant reminders, to inform intervention design [38]. Two other studies quantitatively measured potential sources of barriers, including a real-time assessment of reasons for rejecting prescription recommendations [40], and a survey of clinicians’ attitudes toward antibiotic resistance before and after the intervention implementation [45]. In other studies, authors interpretations referred to potential barriers but there was no formal measurement or indication if these potential barriers were considered in intervention design. Barriers and their related Theoretical Domains Framework (TDF) domains are reported in Table 6. More detailed summaries of identified barriers and related TDF domains can be found in Additional file 4.

Table 6 Categorisation of barriers to the Theoretical Domain Framework (TDF) domains
Full size table

The most frequently identified barriers related to the Environmental Context and Resources domain (n = 9). Issues including; an unestablished electronic health record [38, 43], emergency settings experiencing issues of continuity of care and severely ill patients [37], a lack of morale in healthcare staff and an increased volume of patients [36] were highlighted as potential barriers to de-implementation. The need for additional information [42] or data entry required [38] for the decision support strategies to work were also reported as barriers. Additionally, the type of information offered and the timing of the decision support intervention being too late [38] were also identified.

Barriers relating to the Knowledge domain were the second most frequently identified (n = 5). Clinicians knowledge of; what constitutes an inappropriate prescription [37], the illnesses that are responsive to antibiotics [37], where a reduction in dose is required [41] and how to utilise an intervention were reported as potential barriers [36]. In two of the studies aiming to reduce antibiotic prescribing, authors reported that intervention information that contradicted clinicians training [44] or treatment decisions [39] was likely to prevent successful de-implementation. In addition, although not widely mentioned, Goal-related barriers such as a clinician’s lack of interest or underestimation of low-value prescription issues [43] may also have the potential to impact on de-implementation.

Social influences barriers were also cited to potentially impact de-implementation (n = 3). Patients were reported to demand medication [40] or have a general influence on prescriptions [43]. Social influence barriers also included clinicians attempting to be consistent with colleague’s prescriptions [40, 41] but were only cited in studies conducted in emergency settings. The specific culture of emergency settings was noted to have an impact on de-implementation. Clinicians in these contexts were ensuring the patient gets the medication they are expecting and not disrupting another prescriber’s decision. These contextual barriers were reported to impact new and refilled prescriptions [40, 41].

Facilitators

Most facilitators identified (Table 7) related to the Environmental context and resources domain (n = 8). Ensuring the intervention was easy to use [35, 38], tailored to the local context [39, 45], supported by infrastructure [36, 40, 45], available at the time of a prescription decision [40] and of low cost [35, 39,40,41] were identified as likely to facilitate de-implementation. More detailed summaries of identified barriers and related TDF domains can be found in Additional file 5.

Table 7 Categorisation of facilitators to the Theoretical Domain Framework (TDF) domains
Full size table

Other possible facilitators of de-implementation included clinicians having a correct understanding of appropriate prescriptions (Knowledge) [36, 43], obtaining a fuller record of symptoms (Skills) [38], being more experienced (Skills) [40], being provided with a choice in treatment options (Social/Professional role and Identity) [45] and avoiding alert fatigue (Memory, Attention and Decision Processes) [38]. Healthcare staff feeling that changing their behaviour can have a positive impact on patients (Beliefs about consequences), and motivation to further reduce already low rates of inappropriate prescribing (Goals) [45] were identified as other possible facilitators.

Consequences of de-implementation

Consequences that could have been caused by the intervention were identified in nine studies [35,36,37,38,39,40, 42, 43, 45] and were identified through secondary outcomes and additional analyses. Table 8 provides the number of identified consequences categorised to the conceptual framework [21]. Desirable (n = 22), undesirable (n = 4), expected (n = 6) and unexpected consequences (n = 4) were identified. Many authors of included studies did not clarify if a difference (or non-difference) between arms indicated a desirable or undesirable outcome and even less so if these outcomes were expected or unexpected. More details of consequences can be found in Additional file 6.

Table 8 Number of consequences identified in studies
Full size table

Desirable and undesirable consequences were usually related to patient safety. Desirable consequences included a reduction in duration of fever [39], fever at day 7 and secondary antibiotic prescriptions [42] and reduced length of stay in hospital [35, 39]; however, one study reported this could have been a cofounded finding [35]. Conversely, an intervention using educational materials (and a decision support system, which was not utilised) found patients at intervention sites had a significantly longer length of stay [43] but did not make clear if this was unexpected. Three studies reported a desirable consequence that their intervention did not adversely impact the appropriate process of care or prescriptions being given to patients who required such medications [36, 37, 42].

One study, using reminders, reported a financially desirable consequence, where a change in the type of medication used was associated with a reduction in medication cost [39], whereas, another intervention using modified lab reporting was not associated with a cost saving [35].

Other undesirable consequences were identified. Consequences arising from the clinician’s interaction with the intervention were also identified. One study using a decision support system reported that prescribing outcomes improved for all types of reminders a clinician received (i.e. reminders of evidence-based practice or potential drug interactions) and did not increase alert fatigue, which are desirable consequences [38]. However, the amount of time required to select a medication using the decision support increased over the course of the trial, again, Moja and colleagues did not define this as unexpected or a reasonable trade-off [38].

In one of the multifaceted interventions, consequences were identified through a pre-post measure of attitudes towards antibiotic stewardship [45]. More clinicians reported a positive attitude and agreed that stewardship was important following the intervention, which could indicate a desirable consequence. However, in the same study, clinicians also continued to feel that a stewardship intervention would not impact on their decision-making in future [45], which could be an undesirable consequence as it may be counterproductive in de-implementation efforts.

Other consequences could refer to the level of use or acceptance of an intervention. A high level of compliance or use of the intervention is assumed to correspond with intervention success; however generally, a potential trade-off or realistic expectation is that the intervention will not reach 100% uptake. For example, one study reported 43% of recommendations were accepted and continued to produce an effective outcome; however, it was not clear if this level of acceptance was expected or desired [40].

Discussion

This review aimed to understand the effectiveness, barriers, facilitators, and consequences of strategies de-implementing low-value medication prescribing in secondary healthcare. The majority of included studies were found to significantly reduce inappropriate medication prescribing (n = 7/11). Included studies addressed various low-value prescribing practices, the majority addressed antibiotic use (n = 6) and others targeted malaria therapies in non-malaria patients, unnecessary medication for older people or in general. We deductively extracted data to further understand the complexities of de-implementation as conceptualised in Norton and Chambers de-implementation framework [18].

Despite the widespread efforts to reduce low-value care [46], only a few strategies were identified and even fewer successfully de-implemented low-value prescribing practice in secondary healthcare. Effective strategies included single strategy clinician decision support systems (n = 6), financial incentives (n = 1) and a multi-faceted intervention including components of education and audit and feedback (n = 1). This is consistent with the literature as strategies to reduce low-value care across the health system found clinicians’ decision support and multifaceted interventions (usually including education) to be most utilised and effective [8].

In our review, clinical decision support systems were the most common and effective strategy to de-implement inappropriate prescribing. This aligns with a more recent systematic review of strategies that addressed low-value care in cancer services [47]. Alishahi Tabriz and colleagues postulated that the success of decision support strategies was due to aids being ‘active’ as opposed to ‘passive’. ‘Active’ strategies are intentional and exerted efforts to facilitate change in behaviour or ways of working [47]. ‘Active’ strategies have previously been found useful in de-implementation. In a scoping review conducted in 2015 of de-implementation interventions in healthcare more generally, de-implementation happened when evidence was diffused; however, those using an ‘active’ intervention to aid the use of evidence, such as clinician education or withdrawing a medication from the market, were more likely to lead to successful de-implementation [10]. To ensure effective de-implementation, efforts should move away from passive dissemination of evidence and offer ‘active’, intentional and exerted interventions, such as clinical decision support systems, to facilitate de-implementation.

Educational strategies, of educational materials and educational meetings, were the second most commonly used strategies to reduce low-value prescribing, however only one reported a significant effect [37]. These educational strategies were multifaceted and were usually paired with audit and feedback or monitoring. Previous literature has shown educational strategies to be effective when paired with other strategies [8]. Additionally, multi-faceted strategies using clinical educational or academic detailing among other strategies are likely to facilitate de-implementation and curb low-value care compared to being used alone [48]. Metlay and colleagues, authors of the effective multifaceted intervention, using education, audit and feedback, did not offer reasons for success; however, they noted the need to distinguish the most suitable ‘active ingredient/s’ of their intervention [37]. There have been strides to identify the active ingredients or behavioural change techniques used in de-implementation interventions however, more needs to be done to understand the utility of these components and which ingredients would facilitate the most significant effect [29]. Where educational strategies are paired with other strategies, a clearer understanding of the degree to which education content, or the behaviour change techniques within educational strategies can facilitate de-implementation is required to optimise their contribution to de-implementation in future.

Consideration of determinants that may prevent or enable de-implementation [49] were also explored in our review. Only one study in our review explicitly identified potential barriers before implementing their intervention [38], others offered interpretations of potentially influential determinants retrospectively. Most identified potential barriers related to the TDF domain of Environmental context and resources, particularly strategies utilising decision support. Intervening at the point of care was seen as beneficial [41] and can disrupt clinicians’ decision-making to influence a change in decision [50], but is likely to face many pitfalls [51]. Only one study, although effective, found prescribing decisions may have been made in advance of interacting with computer systems and decision support may have been offered “too late” [38]. Across included studies decision support was usually offered at ‘point of care’ (we assume once a prescription was decided). If the decision process for prescribing happens before the time a clinician engages with a computer, a change in the decision and subsequent de-implementation of the selected behaviour may be more difficult or unsustained. Explicit specification of ‘when’ and ‘where’ these decision aid strategies operate are required to understand the extent these context factors affect the decision support success [52]. Additionally, measurement of these factors will allow for further optimisation of ‘point of care’ de-implementation strategies.

The setting and culture in which an intervention is embedded should be a main consideration for designing and optimising de-implementation strategies [20]. Barriers relating to the wider context (as highlighted in the Environmental context and resources domain) were frequently identified across studies. Two of five studies conducted in emergency settings, referred to the ‘specific culture’ of these settings hindering de-implementation [37, 40]. Continuity of care, dealing with very sickly patients and the desire to not deviate from other clinician’s plans were viewed as potential barriers in these settings. The importance of the setting of the de-implementation intervention has been emphasised in previous research. In a systematic review of determinants of low-value care nursing practices, characteristics of the setting such as the type of department, organisational norms and structure were found to be influential in both, the use of low-value practices and de-implementation process [53]. Additionally, the wider culture including political support or pressure and economy were also notable determinants of de-implementation [53], although these factors were not identified in the current review. Intervention designers are required to have a clear appreciation of the context and setting within which de-implementation efforts are implemented to better understand and attempt to influence these determinants.

Consequences produced by the intervention, where reported, tended to be ‘desirable’ (i.e. reduced length of stay). Consequences were classified to a framework as suggested by Toma and colleagues [21] where phrasing of findings or authors’ interpretations made classification possible. It was difficult to understand if a measured outcome not having a difference between arms (e.g. no difference between arms for frequency of return hospital visits) should be categorised as a ‘desirable’ or an ‘undesirable’ consequence. However, where a difference was experienced such as a significant reduction in the length of stay in hospital in intervention arms [35, 39], classification was more easily allocated. Clearer expectations of potential consequences are required to understand if undesirable or unexpected consequences are acceptable trade-offs of de-implementation.

Consideration of how the reduction or removal of a low-value practice may impact appropriate care has already been highlighted as a potential consequence that should be captured in any de-implementation effort [19]. Only three (of 11) studies in the current review measured the impact of their strategies on appropriate prescriptions. Evaluations of strategies need to widen the scope, to consider expected, unexpected, desirable and undesirable consequences of de-implementation on patients, providers and organisations to account for any impact on appropriate care caused by the de-implementation of low-value care [20]. Further research on the impact of and recurrence of these consequences will contribute to a fuller understanding of the impact of de-implementation strategies on appropriate and necessary care [21].

The continuation of low-value prescribing practices is an evidence-practice gap which requires a change in clinical behaviour. This review considered the determinants, strategies and consequences that influence de-implementation. This review has highlighted the relevant ‘complexities’ using Norton and Chamber’s framework [18] to further understand the process of de-implementation. To ensure effective de-implementation in future, strategies need to be informed by formulation work to understand determinants and account for potential consequences. This can be achieved through rigorous and theoretically informed research which in turn will contribute to an accumulation of knowledge about how and why de-implementation strategies work [54].

Strengths and limitations

The strength of this review was its comprehensive search strategy. Developed with an information officer, the search strategy included the terms unique to the field of de-implementation [10] which ensured relevant studies were identified. Another strength was the comprehensive use of conceptual frameworks to understand the features of de-implementation and key areas required for further understanding of de-implementation. Comparisons across frameworks provide a theoretical lens and help identify where there are similarities or where gaps in knowledge exist.

However, there were limitations. First, only studies written in English, with a RCT design were included. Other study designs may have provided more information about barriers and facilitators or consequences of de-implementation strategies. Second, studies were excluded if they failed to define the setting or where the intervention target behaviour was not clearly defined as de-implementation. Unspecific language such as ‘change’ or ‘improve’ often used to describe de-implementation strategies was not captured in our search strategy. This meant that studies with an aim to reduce inappropriate practices may have been excluded on this basis.

A final limitation is that a meta-analysis was not performed to assess the effectiveness of included de-implementation strategies; instead, this review reported if they were effective or not. This review only included RCTs, considered the gold standard for the evaluation of strategies, as opposed to uncontrolled studies that may be poorer in quality. However, all included RCT risk of biases were assessed as high and moderate; therefore, quality should be a consideration in the interpretation of these results.

Conclusions

In conclusion, this review has demonstrated that multiple intervention strategies were found to effectively de-implement inappropriate prescribing in secondary healthcare. Clinical decision support systems were the most effective and educational strategies may be useful; however, more research needs to be done to establish the degree to which these components are effective. Generally, environmental, contextual, social and knowledge-driven barriers and facilitators need to be taken into consideration when replicating or optimising de-implementation strategies. Specification of features, such as timing and context, should also be reported to gain insight to how best to optimise these strategies in future. Finally, any expected, unexpected or desirable and undesirable consequences caused by the intervention need to be measured to ensure the accumulation of knowledge of possible consequences to fully account for the impact of de-implementation.

Availability of data and materials

The data generated or analysed in this review is available from the corresponding author on reasonable request.

Abbreviations

RCT:

Randomised control trial

RoB:

Risk of bias

TDF:

Theoretical Domains Framework

EPOC:

Effective Practice and Organisation of Care

References

  1. Brownlee S, Chalkidou K, Doust J, Elshaug AG, Glasziou P, Heath I, et al. Evidence for overuse of medical services around the world. Lancet. 2017;390:156–68. https://doi.org/10.1016/S0140-6736(16)32585-5.

    Article  PubMed  PubMed Central  Google Scholar 

  2. Department of Health & Social Care. Good for you, good for us, good for everybody: a plan to reduce overprescribing to make patient care better and safer, support the NHS, and reduce carbon emissions. 2021;85.

  3. NICE. Our principles | Who we are | About [Internet]. NICE. NICE; 2022 [cited 2022 Aug 9]. Available from: https://www.nice.org.uk/about/who-we-are/our-principles.

  4. Choosing Wisely UK. About Choosing Wisely UK [Internet]. Choosing Wisely UK. 2022. Cited 2022 June 10. Available from: https://www.choosingwisely.co.uk/about-choosing-wisely-uk/.

  5. Rosenberg A, Agiro A, Gottlieb M, Barron J, Brady P, Liu Y, et al. Early Trends Among Seven Recommendations From the Choosing Wisely Campaign. JAMA Intern Med. 2015;175:1913–20. https://doi.org/10.1001/jamainternmed.2015.5441.

    Article  PubMed  Google Scholar 

  6. Rourke EJ. Ten Years of Choosing Wisely to Reduce Low-Value Care. N Engl J Med. 2022;386:1293–5. https://doi.org/10.1056/NEJMp2200422.

    Article  PubMed  Google Scholar 

  7. Prasad V, Ioannidis JP. Evidence-based de-implementation for contradicted, unproven, and aspiring healthcare practices. Implement Sci. 2014;9:1. https://doi.org/10.1186/1748-5908-9-1.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Colla CH, Mainor AJ, Hargreaves C, Sequist T, Morden N. Interventions Aimed at Reducing Use of Low-Value Health Services: A Systematic Review. Med Care Res Rev. 2017;74:507–50. https://doi.org/10.1177/1077558716656970.

    Article  PubMed  Google Scholar 

  9. Ellen ME, Wilson MG, Vélez M, Shach R, Lavis JN, Grimshaw JM, et al. Addressing overuse of health services in health systems: a critical interpretive synthesis. Health Res Policy Syst. 2018;16:48. https://doi.org/10.1186/s12961-018-0325-x.

    Article  PubMed  PubMed Central  Google Scholar 

  10. Niven DJ, Mrklas KJ, Holodinsky JK, Straus SE, Hemmelgarn BR, Jeffs LP, et al. Towards understanding the de-adoption of low-value clinical practices: a scoping review. BMC Med. 2015;13:255. https://doi.org/10.1186/s12916-015-0488-z.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Norton WE, Chambers DA, Kramer BS. Conceptualizing De-Implementation in Cancer Care Delivery. J Clin Oncol. 2019;37:93–6. https://doi.org/10.1200/JCO.18.00589.

    Article  PubMed  Google Scholar 

  12. van Bodegom-Vos L, Davidoff F, Marang-van de Mheen PJ. Implementation and de-implementation: two sides of the same coin? BMJ Qual Saf. 2017;26:495–501. https://doi.org/10.1136/bmjqs-2016-005473.

    Article  PubMed  Google Scholar 

  13. Patey AM, Grimshaw JM, Francis JJ. Changing behaviour, ‘more or less’: do implementation and de-implementation interventions include different behaviour change techniques? Implement Sci. 2021;16:20. https://doi.org/10.1186/s13012-021-01089-0.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Prusaczyk B, Swindle T, Curran G. Defining and conceptualizing outcomes for de-implementation: key distinctions from implementation outcomes. Implementation Sci Commun. 2020;1:43. https://doi.org/10.1186/s43058-020-00035-3.

    Article  Google Scholar 

  15. Patey AM, Hurt CS, Grimshaw JM, Francis JJ. Changing behaviour ‘more or less’—do theories of behaviour inform strategies for implementation and de-implementation? A critical interpretive synthesis. Implementation Sci. 2018;13:134. https://doi.org/10.1186/s13012-018-0826-6.

    Article  Google Scholar 

  16. Parsons Leigh J, Niven DJ, Boyd JM, Stelfox HT. Developing a framework to guide the de-adoption of low-value clinical practices in acute care medicine: a study protocol. BMC Health Serv Res. 2017;17. Cited 2022 May 6. https://doi.org/10.1186/s12913-017-2005-x.

  17. Powell AA, Bloomfield HE, Burgess DJ, Wilt TJ, Partin MR. A Conceptual Framework for Understanding and Reducing Overuse by Primary Care Providers. Med Care Res Rev. 2013;70:451–72. https://doi.org/10.1177/1077558713496166.

    Article  PubMed  Google Scholar 

  18. Norton WE, Chambers DA. Unpacking the complexities of de-implementing inappropriate health interventions. Implement Sci. 2020;15:2. https://doi.org/10.1186/s13012-019-0960-9.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Kerr EA, Kullgren JT, Saini SD. Choosing Wisely: How To Fulfill The Promise In The Next 5 Years. Health Aff. 2017;36:2012–8. https://doi.org/10.1377/hlthaff.2017.0953.

    Article  Google Scholar 

  20. Mafi JN, Parchman M. Low-value care: an intractable global problem with no quick fix. BMJ Qual Saf. 2018;27:333–6. https://doi.org/10.1136/bmjqs-2017-007477.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Toma M, Davey PG, Marwick CA, Guthrie B. A framework for ensuring a balanced accounting of the impact of antimicrobial stewardship interventions. J Antimicrob Chemother. 2017;72:3223–31. https://doi.org/10.1093/jac/dkx312.

    Article  CAS  PubMed  Google Scholar 

  22. Walsh-Bailey C, Tsai E, Tabak RG, Morshed AB, Norton WE, McKay VR, et al. A scoping review of de-implementation frameworks and models. Implement Sci. 2021;16:100. https://doi.org/10.1186/s13012-021-01173-5.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Grimshaw JM, Patey AM, Kirkham KR, Hall A, Dowling SK, Rodondi N, et al. De-implementing wisely: developing the evidence base to reduce low-value care. BMJ Qual Saf. 2020;29:409–17. https://doi.org/10.1136/bmjqs-2019-010060.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Nilsen P, Ingvarsson S, Hasson H, von Thiele SU, Augustsson H. Theories, models, and frameworks for de-implementation of low-value care: A scoping review of the literature. Implementation Res Pract. 2020;1:2633489520953762. https://doi.org/10.1177/2633489520953762.

    Article  Google Scholar 

  25. Cane J, O’Connor D, Michie S. Validation of the theoretical domains framework for use in behaviour change and implementation research. Implement Sci. 2012;7:37. https://doi.org/10.1186/1748-5908-7-37.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Voorn VMA, Marang-van de Mheen PJ, Wentink MM, Kaptein AA, Koopman-van Gemert AWMM, So-Osman C, et al. Perceived barriers among physicians for stopping non-cost-effective blood-saving measures in total hip and total knee arthroplasties. Transfusion. 2014;54:2598–607. https://doi.org/10.1111/trf.12672.

    Article  PubMed  Google Scholar 

  27. Cullinan S, Fleming A, O’Mahony D, Ryan C, O’Sullivan D, Gallagher P, et al. Doctors’ perspectives on the barriers to appropriate prescribing in older hospitalized patients: a qualitative study. Br J Clin Pharmacol. 2015;79:860–9. https://doi.org/10.1111/bcp.12555.

    Article  PubMed  PubMed Central  Google Scholar 

  28. Skolarus TA, Forman J, Sparks JB, Metreger T, Hawley ST, Caram MV, et al. Learning from the “tail end” of de-implementation: the case of chemical castration for localized prostate cancer. Implementation Science Communications. 2021;2:124. https://doi.org/10.1186/s43058-021-00224-8.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Patey AM, Islam R, Francis JJ, Bryson GL, Grimshaw JM, the Canada PRIME Plus Team. Anesthesiologists’ and surgeons’ perceptions about routine pre-operative testing in low-risk patients: application of the Theoretical Domains Framework (TDF) to identify factors that influence physicians’ decisions to order pre-operative tests. Implement Sci. 2012;7:52. https://doi.org/10.1186/1748-5908-7-52.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Parsons Leigh J, Sypes EE, Straus SE, Demiantschuk D, Ma H, Brundin-Mather R, et al. Determinants of the de-implementation of low-value care: a multi-method study. BMC Health Serv Res. 2022;22:450. https://doi.org/10.1186/s12913-022-07827-4.

    Article  Google Scholar 

  31. Landis JR, Koch GG. The Measurement of Observer Agreement for Categorical Data. Biometrics. 1977;33:159–74. https://doi.org/10.2307/2529310.

    Article  CAS  PubMed  Google Scholar 

  32. Effective Practice and Organisation of Care. Effective Practice and Organisation of Care (EPOC). EPOC Taxonomy. 2015. Cited 2021 June 16. Available from: https://epoc.cochrane.org/sites/epoc.cochrane.org/files/public/uploads/taxonomy/epoc_taxonomy.pdf.

  33. Rogers EM. Diffusion of Innovations. 5th ed. New York: Free Press; 2003.

    Google Scholar 

  34. Higgins JPT, Thomas J, Chandler J, Cumpston M, Li T, Page MJ, et al. Cochrane Handbook for Systematic Reviews of Interventions. Wiley; 2019. Available from: https://training.cochrane.org/handbook.

  35. Daley P, Garcia D, Inayatullah R, Penney C, Boyd S. Modified Reporting of Positive Urine Cultures to Reduce Inappropriate Treatment of Asymptomatic Bacteriuria Among Nonpregnant, Noncatheterized Inpatients: A Randomized Controlled Trial. Infect Control Hosp Epidemiol. 2018;39:814–9. https://doi.org/10.1017/ice.2018.100.

    Article  PubMed  Google Scholar 

  36. Menya D, Platt A, Manji I, Sang E, Wafula R, Ren J, et al. Using pay for performance incentives (P4P) to improve management of suspected malaria fevers in rural Kenya: a cluster randomized controlled trial. BMC Med. 2015;13:268. https://doi.org/10.1186/s12916-015-0497-y.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  37. Metlay JP, Camargo CA, MacKenzie T, McCulloch C, Maselli J, Levin SK, et al. Cluster-Randomized Trial to Improve Antibiotic Use for Adults With Acute Respiratory Infections Treated in Emergency Departments. Ann Emerg Med. 2007;50:221–30. https://doi.org/10.1016/j.annemergmed.2007.03.022.

    Article  PubMed  Google Scholar 

  38. Moja L, Polo Friz H, Capobussi M, Kwag K, Banzi R, Ruggiero F, et al. Effectiveness of a Hospital-Based Computerized Decision Support System on Clinician Recommendations and Patient Outcomes: A Randomized Clinical Trial. JAMA Netw Open. 2019;2:e1917094. https://doi.org/10.1001/jamanetworkopen.2019.17094.

    Article  PubMed  PubMed Central  Google Scholar 

  39. Paul M, Andreassen S, Tacconelli E, Nielsen AD, Almanasreh N, Frank U, et al. Improving empirical antibiotic treatment using TREAT, a computerized decision support system: cluster randomized trial. J Antimicrob Chemother. 2006;58:1238–45. https://doi.org/10.1093/jac/dkl372.

    Article  CAS  PubMed  Google Scholar 

  40. Terrell KM, Perkins AJ, Dexter PR, Hui SL, Callahan CM, Miller DK. Computerized Decision Support to Reduce Potentially Inappropriate Prescribing to Older Emergency Department Patients: A Randomized, Controlled Trial: Decision support for inappropriate prescribing. J Am Geriatr Soc. 2009;57:1388–94. https://doi.org/10.1111/j.1532-5415.2009.02352.x.

    Article  PubMed  Google Scholar 

  41. Terrell KM, Perkins AJ, Hui SL, Callahan CM, Dexter PR, Miller DK. Computerized Decision Support for Medication Dosing in Renal Insufficiency: A Randomized Controlled Trial. Ann Emerg Med. 2010;56:623-629.e2. https://doi.org/10.1016/j.annemergmed.2010.03.025.

    Article  PubMed  Google Scholar 

  42. van de Maat JS, Peeters D, Nieboer D, van Wermeskerken A-M, Smit FJ, Noordzij JG, et al. Evaluation of a clinical decision rule to guide antibiotic prescription in children with suspected lower respiratory tract infection in The Netherlands: A stepped-wedge cluster randomised trial. PLoS Med. 2020;17:e1003034. https://doi.org/10.1371/journal.pmed.1003034.

    Article  PubMed  PubMed Central  Google Scholar 

  43. Franchi C, Tettamanti M, Djade CD, Pasina L, Mannucci PM, Onder G, et al. E-learning in order to improve drug prescription for hospitalized older patients: a cluster-randomized controlled study: E-learning to improve drug prescription. Br J Clin Pharmacol. 2016;82:53–63. https://doi.org/10.1111/bcp.12922.

    Article  PubMed  PubMed Central  Google Scholar 

  44. Opondo C, Ayieko P, Ntoburi S, Wagai J, Opiyo N, Irimu G, et al. Effect of a multi-faceted quality improvement intervention on inappropriate antibiotic use in children with non-bloody diarrhoea admitted to district hospitals in Kenya. BMC Pediatr. 2011;11:109. https://doi.org/10.1186/1471-2431-11-109.

    Article  PubMed  PubMed Central  Google Scholar 

  45. Yadav K, Meeker D, Mistry RD, Doctor JN, Fleming-Dutra KE, Fleischman RJ, et al. A Multifaceted Intervention Improves Prescribing for Acute Respiratory Infection for Adults and Children in Emergency Department and Urgent Care Settings. Choo EK, editor. Acad Emerg Med. 2019;26:719–31. https://doi.org/10.1111/acem.13690.

    Article  PubMed  PubMed Central  Google Scholar 

  46. Levinson W, Kallewaard M, Bhatia RS, Wolfson D, Shortt S, Kerr EA, et al. “Choosing Wisely”: a growing international campaign. BMJ Qual Saf. 2015;24:167–74. https://doi.org/10.1136/bmjqs-2014-003821.

    Article  PubMed  Google Scholar 

  47. Alishahi Tabriz A, Turner K, Clary A, Hong Y-R, Nguyen OT, Wei G, et al. De-implementing low-value care in cancer care delivery: a systematic review. Implement Sci. 2022;17:24. https://doi.org/10.1186/s13012-022-01197-5.

    Article  PubMed  PubMed Central  Google Scholar 

  48. Cliff BQ, Avanceña ALv, Hirth RA, Lee S-YD. The Impact of Choosing Wisely Interventions on Low-Value Medical Services: A Systematic Review. Milbank Quart. 2021;99:1024–58. https://doi.org/10.1111/1468-0009.12531.

    Article  Google Scholar 

  49. van Bodegom-Vos L, Davidoff F, de Mheen PJM. Implementation and de-implementation: two sides of the same coin? BMJ Qual Saf. 2017;26:495–501. https://doi.org/10.1136/bmjqs-2016-005473.

    Article  PubMed  Google Scholar 

  50. Helfrich CD, Rose AJ, Hartmann CW, van Bodegom-Vos L, Graham ID, Wood SJ, et al. How the dual process model of human cognition can inform efforts to de-implement ineffective and harmful clinical practices: A preliminary model of unlearning and substitution. J Eval Clin Pract. 2018;24:198–205. https://doi.org/10.1111/jep.12855.

    Article  PubMed  PubMed Central  Google Scholar 

  51. Sutton RT, Pincock D, Baumgart DC, Sadowski DC, Fedorak RN, Kroeker KI. An overview of clinical decision support systems: benefits, risks, and strategies for success. Npj Digital Medicine. 2020;3:1–10. https://doi.org/10.1038/s41746-020-0221-y.

    Article  Google Scholar 

  52. Proctor EK, Powell BJ, McMillen JC. Implementation strategies: recommendations for specifying and reporting. Implement Sci. 2013;8:139. https://doi.org/10.1186/1748-5908-8-139.

    Article  PubMed  PubMed Central  Google Scholar 

  53. Augustsson H, Ingvarsson S, Nilsen P, von Thiele SU, Muli I, Dervish J, et al. Determinants for the use and de-implementation of low-value care in health care: a scoping review. Implementation Sci Commun. 2021;2:13. https://doi.org/10.1186/s43058-021-00110-3.

    Article  Google Scholar 

  54. Lewis CC, Boyd MR, Walsh-Bailey C, Lyon AR, Beidas R, Mittman B, et al. A systematic review of empirical studies examining mechanisms of implementation in health. Implement Sci. 2020;15:21. https://doi.org/10.1186/s13012-020-00983-3.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

We acknowledge Mr Paul Manson, Information Officer, from the Health Services Research Unit, University of Aberdeen for their instrumental help with designing the search strategy.

Funding

This review was part of a PhD studentship supported by the CRANES charity.

Author information

Authors and Affiliations

  1. Academic Urology Unit, University of Aberdeen, Aberdeen, UK

    Jennifer Dunsmore, Sara MacLennan, James N’Dow & Steven MacLennan

  2. Health Service Research Unit, University of Aberdeen, Aberdeen, UK

    Eilidh Duncan

Authors
  1. Jennifer Dunsmore
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Eilidh Duncan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sara MacLennan
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. James N’Dow
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Steven MacLennan
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

JD, ED and SM completed the literature search, screening, data extraction, risk of bias assessment and analysis stages. JD drafted the manuscript. SM, ED, SJM and JND reviewed the manuscript and approved it for submission.

Corresponding author

Correspondence to Jennifer Dunsmore.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

This study does not contain any identifiable information.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1.

PRISMA Checklist for systematic review and Abstracts.

Additional file 2.

Table of Number of types of comparators and Table of Verbatim Intervention and comparator Name and Descriptions.

Additional file 3.

Table of Outcomes and effects of the intervention.

Additional file 4.

Table of Barriers to de-implementation categorised to the TDF Domains.

Additional file 5.

Table of Facilitators to de-implementation categorised to the TDF Domains.

Additional file 6.

Table of Reported consequences in included studies.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Dunsmore, J., Duncan, E., MacLennan, S. et al. Effectiveness of de-implementation strategies for low-value prescribing in secondary care: a systematic review. Implement Sci Commun 4, 115 (2023). https://doi.org/10.1186/s43058-023-00498-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s43058-023-00498-0

Keywords

Implementation Science Communications

ISSN: 2662-2211