Skip to main content

Project Khanya: a randomized, hybrid effectiveness-implementation trial of a peer-delivered behavioral intervention for ART adherence and substance use in Cape Town, South Africa

Abstract

Background

Substance use is prevalent in South Africa and associated with poor HIV treatment outcomes, yet, it is largely unaddressed in HIV care. Implementing an evidence-based, task-shared intervention for antiretroviral therapy (ART) adherence and substance use integrated into HIV care may be a feasible and effective way to improve HIV treatment outcomes and reduce substance use in this population.

Methods

Guided by the RE-AIM framework, a randomized, hybrid type 1 effectiveness-implementation trial (n = 60) is being used to evaluate a peer-delivered intervention that integrates evidence-based intervention components, including Life-Steps (problem solving and motivational skills for HIV medication adherence), behavioral activation to increase alternative, substance-free rewarding activities in one’s environment, and relapse prevention skills, including mindfulness. The comparison condition is enhanced standard of care, which includes facilitating a referral to a local substance use treatment clinic (Matrix). Participants are followed for a period of 6 months. Implementation outcomes are defined by Proctor’s model for implementation and include mixed methods evaluations of feasibility, acceptability, and fidelity, and barriers and facilitators to implementation. Primary patient-level effectiveness outcomes are ART adherence (Wisepill) and substance use (WHO-ASSIST and urinalysis); viral load is an exploratory outcome.

Discussion

Results of this trial will provide important evidence as to whether peer delivery of an integrated intervention for ART adherence and substance use is feasible, acceptable, and effective. Implementation outcomes will provide important insight into using peers as an implementation strategy to extend task sharing models for behavioral health in resource-limited settings globally.

Trial registration

ClinicalTrials.gov identifier: NCT03529409. Trial registered on May 18, 2018.

Introduction

South Africa (SA) is home to the largest number of people living with HIV (PLWH) in the world—approximately 7.7 million [1]. With limited antiretroviral therapy (ART) regimens available in SA, there is high risk of ART nonadherence and treatment failure [2]. Alongside the HIV epidemic, there has been an alarming increase in substance use (SU) in SA [3, 4], though SU is largely unaddressed in HIV care. This is a “missed opportunity” for maximizing HIV treatment, given that untreated, problematic SU is associated with worse ART adherence, lower rates of viral suppression, and greater likelihood of HIV transmission [5,6,7,8,9]. SU treatment utilization in SA is low; only approximately 2.3% of individuals seeking care receive minimally adequate treatment [10]. Although integrated services are more efficacious [11] and there is a push towards integrated care models for PLWH in low and middle-income countries (LMICs) [12] and in SA specifically [13], this is not a routine practice for ART adherence and SU treatment in SA [14]. Implementation science research is needed to understand how to feasibly, effectively, and efficiently integrate SU treatment into HIV care in SA.

In particular, sustainability must be considered, especially for LMICs. Given the lack of availability of trained mental health and SU professionals in this setting, an implementation strategy will require “task sharing” [15, 16]. Task sharing models include hiring and training less specialized health care workers, such as community health workers (CHWs) or lay counselors, to deliver mental health services under the supervision of more highly trained professionals [17]. Task sharing mental health treatment has largely focused on training lay adherence counselors and CHWs and to a much lesser extent peers [18, 19]. When considering scale-up of task-shared mental health interventions, there are known implementation barriers using lay adherence counselors and/or CHWs, including high caseloads, already being burdened with numerous clinical demands, as well as high levels of stigma towards SU [20]. Peers add an ability to share lived experience that can foster connection with patients and potentially reduce stigma [21]. Indeed, formative work leading up to this trial pointed to an overwhelming preference for peer-delivered SU counseling [20]. Peer-delivered SU interventions have been scaling in the USA and have been shown to be efficacious for improving engagement in care, reducing costly utilization, and improving SU outcomes [22].

This trial builds upon prior and ongoing work in SA that has largely, until recently, focused on efficacy (vs. implementation) research for treating alcohol use among PLWH [14, 23, 24]. The current trial builds upon these prior studies in several ways, including (1) screening individuals who are also using other substances in addition to alcohol; (2) targeting recruitment of individuals who are struggling with ART adherence, engagement in care, and/or viral suppression; (3) using a hybrid effectiveness-implementation design; and (4) utilizing an implementation strategy of peer delivery as opposed to an HIV counselor or CHW.

Trial objectives

The primary objective of this trial is to evaluate the effectiveness and implementation of an integrated, peer-delivered SU and ART adherence intervention delivered in HIV care in SA. This trial will contribute important insight into the implementation strategy of using peers in a task sharing model—specifically whether a peer-delivered behavioral intervention for SU in HIV care will be feasible, acceptable, and delivered with fidelity and how this compares with prior evidence using other lay health worker task sharing models.

Methods

This manuscript is in accordance with the Standard Protocol Items: Recommended items to address in a clinical trial protocol and related documents (SPIRIT) guidelines. See Additional file 1 SPIRIT checklist.

Trial design

This study is using a hybrid type 1 effectiveness-implementation design [25], guided by RE-AIM [26, 27], given its inclusion of patient- and provider-level outcomes and prior application in sub-Saharan Africa [28, 29]. The intervention being evaluated is a combination of efficacious treatment components, but because it had not previously been delivered in this setting, we elected to use a hybrid type 1 design; however, a primary emphasis of this trial is on the implementation in this new context. Implementation outcomes were defined based upon Proctor’s model and recommendations for early implementation assessments [30]. See Table 1 for a description of the RE-AIM constructs and implementation outcome measurements in the current trial. This study is a randomized controlled trial (RCT) with two parallel arms: enhanced standard of care (ESOC) and the active behavioral intervention (locally named “Khanya”), which includes a combination of efficacious intervention components locally adapted for this setting (see descriptions below).

Table 1 RE-AIM framework applied to study outcomes

Participants and study procedures

The study flow CONSORT diagram is illustrated in Fig. 1. Patients are recruited from an HIV clinic in Khayelitsha, a peri-urban area of Cape Town that is predominantly Black African and isiXhosa speaking with the highest HIV prevalence in SA’s Western Cape Province [32]. Potentially eligible and interested patients are approached by study staff for screening. All patients are informed that study participation will in no way affect their treatment at the clinic. Screened participants who meet study inclusion criteria (see below) complete informed consent processes prior to baseline by a trained study research assistant, including a release of relevant medical information, and then complete a baseline assessment. The baseline assessment includes a battery of measures related to HIV infection history, medication adherence, and current and past SU. Participants also begin monitoring their ART adherence using Wisepill [33], a real-time, wireless electronic adherence monitoring device. Randomization to intervention condition occurs 2 weeks after the baseline assessment to establish a baseline level of ART adherence. At randomization, participants are randomly assigned (1:1) to either ESOC or Khanya using a computer-generated chart in the randomization module on REDCap [34]. The study staff clicks “randomize” in REDCap, and the participant’s condition is revealed and cannot be changed. Participants then complete the following major assessment time points: mid-point, post-treatment, and 6-month follow-up. See Additional file 2 for the schedule of enrollment, assessments, and interventions. The post-randomization assessments are conducted by a research assistant who is blinded to participant conditionFootnote 1 with no a priori circumstance under which unblinding is permitted. All participants receive ZAR 150 (~ $10 USD) grocery voucher for major assessments. Participants do not receive financial incentives to attend therapy sessions beyond reimbursing travel costs incurred in order to attend therapy visits (ZAR 50; ~$3 USD).

Fig. 1
figure 1

CONSORT diagram

Eligibility criteria

Eligibility criteria include (1) HIV positive and on ART; (2) 18–65 years of age; (3) moderate SU measured by the WHO Alcohol, Smoking, and Substance Involvement Screening Test (WHO-ASSIST) [35] (alcohol ≥ 11 or other SU ≥ 4, indicating moderate risk of health and other problems); and (4) ART nonadherence in the past 3 months, as measured by either (a) missing at least one refill of ART, (b) reinitiating first-line treatment, (c) being on second-line treatment, or (d) having a detectable viral load. Exclusion criteria are (1) severe opiate use (WHO-ASSIST score > 26) given that opiate substitution therapy may not be available and a higher level of care may be needed, (2) severe alcohol dependence symptoms that may warrant medical management of withdrawal symptoms, (3) active uncontrolled major mental illness (e.g., psychosis, mania) that interferes with study participation, (4) inability to provide informed consent and/or complete procedures in English or isiXhosa, (5) in the third trimester of pregnancy during screening or baseline, or (6) currently enrolled in Matrix or another SU treatment program or study focused on ART adherence or SU.

Interventions

ESOC

Given the implementation science focus, we elected to use a version of standard of care (SOC) as our study comparator. SOC for the treatment of SU, if and when detected in HIV care in SA, is a referral to a local SU treatment clinic. In Khayelitsha, there is a city-funded SU treatment program co-located at the HIV care study site, which follows the Matrix model [36, 37], an evidence-based 16-week program to treat SU. Although the two sites are not connected from the inside, a Matrix treatment center shares a driveway and a wall with the clinic at which this study is taking place. Yet, there is evidence from our preliminary work from this study that clinic patients may not be aware of Matrix [20]. Therefore, we enhance SOC (ESOC) by facilitating screening for SU using the WHO-ASSIST and support the referral to Matrix, which includes offering to accompany participants to the Matrix clinic to schedule an intake, providing a direct referral, and following up on the referral at each subsequent study visit.

Khanya intervention

The Khanya intervention is a six-session, peer-delivered intervention that includes a combination of efficacious intervention components for ART adherence and SU, including Life-Steps (problem solving and motivational skills for HIV medication adherence) [38], motivational interviewing (MI) to explore readiness to change SU and adherence behaviors, behavioral activation to increase alternative, substance-free rewarding activities in one’s environment [39, 40], and relapse prevention skills, including mindfulness [41, 42]. Formative qualitative work [20] was used to adapt the intervention content and implementation strategy to ensure the relevance of the efficacious intervention concepts (e.g., mindfulness, values) to the local culture and to promote feasibility and acceptability of the approach. When participants present for each intervention session, a graph of their ART adherence from the Wisepill device is printed from the server prior to the session and used to aid the discussion of challenges to ART adherence. Participant SU is assessed by a research assistant (not the interventionist) using the Timeline Follow-Back (TLFB) prior to the beginning of each session. The TLFB is used to guide the review of SU in-session and discussed together using an MI approach to explore patterns of use in line with the participant’s goal around SU; this continues in each session as the participant learns skills to address SU, its interference with ART adherence, and other substance-related problems. Each session lasts approximately 45 min to 1 h and builds upon prior session content. Each session ends with a brief mindfulness exercise, and participants are also given a CD with audio recordings of the brief mindfulness exercises in isiXhosa that are covered at the end of each session. Home practice of the intervention skills is assigned between sessions and reviewed at each subsequent session. All sessions are audio recorded for fidelity monitoring. Participants are also offered up to six optional booster sessions that focus on continued practice of skills and relapse prevention. See our team’s prior research [43,44,45] for greater detail on the intervention components.

Implementation strategies

Two implementation strategies that emerged from our formative work included the need for (1) peer delivery of the intervention (i.e., a lay counselor with lived experience with SU and/or HIV) and (2) the use of a flipchart to promote fidelity [20]. We tailored the approach for peer delivery by building flexibility into our intervention, training, and supervision procedures to allow for self-disclosure to accommodate the unique perspective of a peer interventionist and adapted our fidelity assessment to also include these elements. Regarding the flipchart, the ultimate aim is to maximize fidelity while also enhancing participant engagement and comprehension (see Fig. 2). While the participant sees mostly visual depictions of the concepts, the interventionist has a guide on the content to deliver and is able to maintain eye contact while following the structured guide for content delivery.

Fig. 2
figure 2

Depiction of flipchart implementation strategy to promote fidelity in task sharing model

Peer interventionist training

Interventionist training was led by a US-based clinical psychologist (JFM) in SA over 5 days. The training was guided by the flipchart and included a combination of didactic training, interactive, experiential learning of intervention components, including developing one’s own mindfulness practice, and role plays. Following the 5-day in person training, ongoing training and supervision was conducted weekly via videoconferencing and included reflections on one’s own mindfulness practice and personal experience with behavioral activation and feedback on role played sessions. Role plays of the full intervention were conducted with five mock participants and video recorded to allow for ongoing training and fidelity monitoring to determine readiness to begin delivering the intervention.

Supervision

The interventionist receives 1 h of weekly supervision from a US-based PhD-level psychologist with expertise in behavioral interventions for medication adherence and substance use. Supervision sessions are held over Webex, a secure video teleconference service. The interventionist translates one session per week from isiXhosa to English for the supervisor to listen to and provide feedback (separate from the randomly selected sessions that are translated for fidelity ratings). Supervision is focused on fidelity, non-specific clinical skills of the interventionist (e.g., being supportive and nonjudgmental, appropriate self-disclosure), time management, and strategies to reduce burnout.

Study measures

Implementation outcomes

Guided by RE-AIM [26, 27] and Proctor’s model [30], we are assessing early implementation outcomes, including a mixed methods evaluation [46] of acceptability and feasibility, and fidelity of peer delivery.

Acceptability, defined as the tolerability or satisfaction of the approach [30], is assessed using two quantitative assessment measures: (1) a 15-item subscale of a pragmatic, quantitative assessment based on RE-AIM [31] developed by the Applied Mental Health Research group (AMHR) at Johns Hopkins University [31] and (2) quantitative metrics of patient attendance, uptake, and retention in the intervention. The AMHR pragmatic, quantitative assessment [31] is a validated measure assessing key implementation domains for a mental health intervention in a LMIC. Sample items on the acceptability subscale include “Did you feel satisfied with the program’s services?” and “Did you enjoy learning skills from the program?” Psychometric properties of the scale show good internal consistency ( = .89) and test-retest reliability (rho = .70).

Feasibility, defined as the fit or utility of the intervention or suitability and practicability for this setting [30], is also being assessed using two quantitative assessments: (1) the 14-item feasibility subscale of the AMHR pragmatic assessment measure based on RE-AIM [31] and (2) the percentage assigned to the intervention who agree to enroll in the intervention. The feasibility subscale also shows good psychometric properties (internal consistency  = .85; test-retest reliability rho = .79). Sample items from the feasibility subscale include “Have you been able to attend the sessions of the program without difficulty?” and “Did you have enough money to pay for transport to get to the program sessions?” Secondly, we will compare the rates of patient enrollment and participation across conditions with other similar pilot trials [47, 48].

To supplement the quantitative assessments of feasibility and acceptability, qualitative interviews with up to 30 participants are also assessing perceptions of acceptability and feasibility of the intervention, as well as barriers and facilitators to implementation. Qualitative interview guides are based upon Proctor’s model for implementation outcomes [30, 49] and the RE-AIM framework [26, 27]. We are using the qualitative interviews to gain more specificity on which elements of the intervention are acceptable and feasible, as well as elicit participant feedback on ways to improve these implementation outcomes going forward.

Fidelity is being assessed two ways: independent rater and interventionist self-report. The independent rater is listening to a randomly selected subset (20%) of intervention sessions that are translated from isiXhosa to English. A 15- to 19-item fidelity assessment was developed for each session that includes an assessment of whether each core intervention content component was delivered. At the end of each session, the interventionist completes an identical self-report form assessing her level of fidelity to the intervention. In addition to rating content, the independent rater assesses sessions for (a) appropriate self-disclosure given the peer interventionist implementation strategy; (b) presence of actively stigmatizing behaviors; and (c) therapeutic common factors including exhibiting warmth and non-judgmental attitudes, which were adapted from prior research on cross-cultural common factors [50].

Effectiveness outcomes

ART adherence is assessed using Wisepill, a real-time, wireless electronic adherence monitoring device previously used in clinical research in sub-Saharan Africa to assess ART adherence [33]. Wisepill uses cell phone technology to transmit a real-time signal to a web server when the pill box is opened. Participants do not need to come into the clinic for the study to obtain readings. A dose is counted as “taken” if the box is opened ± 2 h from the prescribed time. As has been conducted in prior adherence research (e.g., [51, 52]), adherence will be measured as the number of doses missed divided by doses prescribed between randomization and the post-treatment assessment. The 2-week period from baseline to randomization is the baseline adherence measure.

SU is assessed via both a biological measure (urinalysis) and self-report. Urinalysis is conducted at all-time points using the Confirm BioSciences rapid detect 6-panel urine tests (cocaine, marijuana, amphetamines, opiates, phencyclidine, and alcohol). Urinalysis is supplemented with mandrax testing (a commonly used sedative in the area) using the Methaqualone urine rapid test stick. The WHO-ASSIST, a self-report assessment of SU (alcohol, cannabis, cocaine, opiates, amphetamines, hallucinogens, and other drugs), is administered at screening, when substance use risk in the past 3 months is assessed. At the post-treatment and the follow-up assessments, alcohol and drug use are assessed since the prior assessment. It categorizes individuals into low (0–3 for illicit drugs/0–10 for alcohol), moderate (4–26 for illicit drugs/11–26 for alcohol), or high risk (> 26) for substance use-related problems. The use of the WHO-ASSIST in primary care has been validated in SA [35]. To supplement the WHO-ASSIST, we also administer the TLFB to assess the frequency of alcohol and/or drug use in the past 2 weeks at each assessment. To promote accurate recall of the quantity of alcohol use on the TLFB, participants are aided by the use of empty, locally recognizable alcohol containers that reflect the commonly used forms of alcohol in this population.

Viral suppression, which is measured as the number of HIV viral copies per ml of blood, is extracted from participants’ medical record at each assessement. If viral load results are not available within 3 months of the baseline assessment or 30 days of the two follow-up assessments, participants undergo a separate blood draw for viral load assay at no cost to the patient. Blood samples are stored at the University of Cape Town and tested by the National Health Laboratory Service.

Power considerations and sample size calculations

The main analysis on which the sample size calculation for the quantitative analysis was based is the effect of the experimental intervention vs. ESOC on ART nonadherence at post-treatment. Previous objective measures of ART adherence in substance using populations have estimated average adherence rates of approximately 55% with a standard deviation of 25% [53,54,55]. Assuming similar characteristics in ESOC and based on a sample size of 30 in each arm (recommended as the upper limit sample size for pilot RCTs [56] and pilot hybrid type 1 effectiveness-implementation designs [25, 57]), we will have 80% power to detect an 18% difference in objectively measured ART adherence between study arms using a two-sided test with an alpha level of .05. For qualitative analyses, as recommended in qualitative research [58], proposed sample sizes are estimates of the number of interviews needed to reach theoretical saturation.

Data management and data analysis

Quantitative data are collected using the REDCap interface on a tablet. Data are reviewed twice for quality assurance including checking consistency of participant responses and ensuring that reported values fall within the range of possible values. TLFB is administered using a hardcopy calendar to allow for visual aids to guide participant recall, and these data are later entered into REDCap and double checked for accuracy. Wisepill data are stored on the Wisepill server. Wisepill devices are checked weekly on the server to ensure devices are operational.

Descriptive statistics will be generated to evaluate implementation outcomes. Total scores from the acceptability and feasibility subscales of the AMHR pragmatic, implementation assessment [31] will be created; these scores, alongside data obtained on provider fidelity to the intervention and patient participation and retention, will first be evaluated descriptively. The means and standard deviation of provider fidelity at each session will be calculated. Average session fidelity will be compared with similar lay counselor delivered interventions implemented in SA and peer-delivered interventions in the US; similarly, the percentage of patients participating and retained in the intervention will be described and compared with similar pilot studies [23, 59].

Data from individual interviews to assess implementation outcomes will be analyzed iteratively and follow descriptive qualitative thematic analysis [60]. Guided by RE-AIM and Proctor’s model for defining implementation outcomes, initial concepts related to the central research questions listed will be identified based on the semi-structured interview guide. Concepts will be used to develop a codebook consisting of a label, a definition, and illustrative quotes from the data. All transcripts will be coded independently by two research assistants. Final themes will be agreed upon and inter-rater reliability of coding assessed.

Following recommendations of mixed methods designs [46], we will integrate findings from the qualitative and quantitative methods using a convergent QUANT + qual mixed methods design to assess implementation outcomes [46]. Specifically, themes from the qualitative interviews will be compared with the quantitative descriptive data on feasibility and acceptability, assessing for both convergence and divergence.

Quantitative longitudinal analysis will examine changes in ART nonadherence, SU, and viral load from baseline to post-treatment between the conditions. If appropriate after examining descriptive data, normality, and assumptions, t tests may be used to compare continuous variables (e.g., age, ART nonadherence) and Fisher’s exact test may be used to compare categorical variables (e.g., gender, urinalysis). If the appropriate statistical assumptions are met after examining distributions of main outcome variables, longitudinal data analysis using generalized linear mixed models (GLMM) may be used to compare the two study arms over time. This approach increases power by including all available data points. We will adjust the analyses for relevant baseline demographic characteristics (e.g., gender, age) for each analysis and clinical differences that exist between the two treatment arms. Intent-to-treat analyses will be utilized, where all individuals will be analyzed according to the condition to which they were randomized.

Ethical considerations and trial management

This study is approved by the University of Cape Town (UCT) Human Research Ethics Committee (HREC). Data are de-identified by using participant ID numbers (not names) on all study materials. The document linking participant identifiable information (e.g., names, phone numbers) is stored on a secure institutional server, password protected, and only accessible to the study staff who need access to this information to perform the study duties.

This study has oversight by a Data Safety and Monitoring Board (DSMB). The DSMB meets annually to review data collection procedures and ensure the scientific and ethical rigor of the study is maintained. The DSMB for this trial is comprised of three leading scientists who have expertise in behavioral interventions, HIV, substance use, implementation science, and SA. The DSMB members are independent of the sponsor without competing interests for providing rigorous scientific and ethical oversight. There are no a priori stopping rules for discontinuing or modifying provision of the experimental intervention, although our DSMB has this right and responsibility.

We collect information on adverse events that are experienced by enrolled participants. Adverse events are classified serious/non-serious, related/unrelated to the study intervention, and expected/unexpected. All serious adverse events (i.e., any event considered to be fatal, immediately life-threatening, permanently or substantially disabling, requiring or prolonging inpatient hospitalization, or any congenital anomaly) are reported to UCT HREC within 24 h. We report all adverse events to our DSMB committee yearly.

Key ethical considerations in this trial include protecting the confidentiality and well-being of PLWH and SU. We closely monitor and screen for medically complicated withdrawal symptoms for patients with severe alcohol use who are reducing their alcohol intake as part of the intervention. We maintain a close relationship with the co-located Matrix substance use treatment facility and the medical officer at the clinic to ensure patient safety throughout the trial.

All protocol modifications are submitted as ethics amendments to the UCT HREC. Any major protocol modifications will be reflected on ClinicalTrials.gov. Participants are re-consented following any protocol modifications that would impact their participation in the study, and the UCT HREC approves whether it is necessary to re-consent patients if a major protocol amendment is requested.

Discussion

Given the prevalence of SU among PLWH in SA and interference with HIV care outcomes across the continuum [5,6,7, 9, 61], it is crucial to identify how to integrate and implement evidence-based interventions to treat substance use in HIV care in SA. Identifying intervention components that can be feasibly and sustainably delivered using a task sharing model is essential, as there are significant workforce shortages for behavioral health interventions in SA and other LMICs [15, 62]. Task sharing efforts in SA and elsewhere to date have largely involved task sharing with lay counselors, such as lay adherence counselors or CHWs, as opposed to peers [15, 16, 18, 19]. This trial will contribute new knowledge about the effectiveness and implementation of a peer-delivered intervention using a task sharing model. This study will allow us to gain understanding regarding the feasibility, acceptability, fidelity, and effectiveness of this peer-delivered approach and how these implementation and effectiveness outcomes compare with other lay health worker-delivered task-shared substance use interventions [18, 19]. An integrated intervention that simultaneously addresses substance use and ART adherence offers a parsimonious approach if feasible for peer delivery. As the SA Department of Health refines their strategy for integration of behavioral health services into primary health care facilities, findings may have important implications to understand what may be effective and feasible in this context.

Potential challenges in this trial include difficulties with recruiting and retaining patients who are struggling with SU, ART nonadherence, and engagement in care. By prioritizing recruitment of individuals who have already demonstrated challenges with engagement in care, we are more likely to recruit individuals who will have greater challenges also in engaging in study-related appointments and are difficult to retain. Further, to date, approximately 40% of participants have not owned a cell phone, which makes tracking and retaining participants more challenging. Starting from the point of screening through the 6-month follow-up assessment, retaining this hard-to-reach population is an important priority in this trial, while also balancing real-world implementation that may have limited resources to track and retain difficult populations. Efforts to address these anticipated challenges include identifying participants who we are struggling to retain during weekly team supervision and collecting contact numbers for two people who are likely to know the whereabouts of the participant.

Design considerations and future directions

There are numerous design considerations and decisions that reflect our dual focus on both effectiveness and implementation. For instance, we elected to include booster sessions in our trial design based upon feedback from participants and interventionist observation that additional skill practice would be needed to sustain behavior change, especially in light of fluctuating motivation. However, we also recognize the need to prioritize brevity in our intervention design to ultimately have an intervention package that will enhance the probability of policy uptake within SA’s Department of Health. Thus, we elected to offer optional booster sessions with no financial incentives to provide the option to reinforce ongoing skill practice and relapse prevention and evaluate uptake of these optional booster sessions as an additional measure of acceptability.

Primary limitations relate to this being a pilot trial, including a small sample size and relatively short-term follow-up period. There are also limitations when considering future scale-up of the intervention, including reimbursement for transport costs and financial incentives provided for participating in research assessments and the fact the interventionist was hired to deliver the intervention and was not balancing other clinic responsibilities. This trial is a first step towards evaluating whether this intervention has potential for future scale-up. If it proves to be effective in this setting and early implementation outcomes are promising, next steps would require a larger trial to evaluate longer-term effectiveness and implementation outcomes, including cost effectiveness, maintenance, and sustainability. Further, these outcomes must be assessed at the provider and organizational levels using a greater number of clinic sites and peer interventionists in a future cluster randomized clinical trial. Ultimately, our aim is to develop and evaluate an intervention and implementation strategy that can be scaled up in SA and other LMICs to expand access to evidence-based HIV and behavioral health care in resource-limited primary care settings.

Dissemination plan

The results of this study will be published after all data is collected, cleaned, and analyzed, and the results will be updated in ClinicalTrials.gov within 1 year of the primary completion date. We will also update NIH on the study results in annual progress reports to NIDA. Additionally, we will report back on the study results to the City of Cape Town Health Department, including by holding forums for HIV and SU treatment to share results with clinical providers, patients, and staff.

Availability of data and materials

Data sharing is not applicable to this article as no datasets were generated or analyzed during the current study. However, we will grant public access to the full protocol, de-identified participant-level dataset, and statistical code for interested parties by emailing the study PI. All study key personnel will have access to the final de-identified trial dataset without restrictions.

Notes

  1. Blinded assessor was introduced after ten participants completed the post-treatment assessment and one participant completed the 6-month follow-up due to staffing constraints at study initiation.

Abbreviations

ART:

Antiretroviral therapy

CHW:

Community health worker

DSMB:

Data Safety and Monitoring Board

ESOC:

Enhanced standard of care

GLMM:

General linear mixed models

HREC:

Human Research Ethics Committee

IAA:

Independent Authorization Agreement

IEC:

Independent Ethics Committee

IRB:

Institutional Review Board

LMIC:

Low and middle-income country

MI:

Motivational interviewing

NIMH:

National Institute of Mental Health

PLWH:

People living with HIV

PS:

Problem solving

RCT:

Randomized controlled trial

SA:

South Africa

SOC:

Standard of care

SU:

Substance use

TLFB:

Timeline Follow-Back

UCT:

University of Cape Town

References

  1. UNAIDS. UNAIDS data 2019. Geneva: Joint United Nations Programme on HIV/AIDS (UNAIDS); 2019. https://www.unaids.org/sites/default/files/media_asset/2019-UNAIDS-data_en.pdf.

  2. Marconi VC, Sunpath H, Lu Z, et al. Prevalence of HIV-1 drug resistance after failure of a first highly active antiretroviral therapy regimen in KwaZulu Natal, South Africa. Clin Infect Dis. 2008;46(10):1589–97. https://doi.org/10.1086/587109.

    Article  PubMed  Google Scholar 

  3. Shisana O, Rehle T, Simbayi L, et al. South African national HIV prevalence, incidence, and behaviour survey, 2012. 2014. http://www.hsrc.ac.za/uploads/pageContent/4565/SABSSM%20IV%20LEO%20final.pdf. Accessed 23 Apr 2014.

    Google Scholar 

  4. Pluddemann A. The SACENDU project: monitoring alcohol and drug abuse trends in South Africa. Int J Psychol. 2012;47(S1):167. https://doi.org/10.1080/00207594.2012.709090.

  5. Cook RL, Sereika SM, Hunt SC, Woodward WC, Erlen JA, Conigliaro J. Problem drinking and medication adherence among persons with HIV infection. J Gen Intern Med. 2001;16(2):83–8. https://doi.org/10.1111/j.1525-1497.2001.00122.x.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  6. Kader R, Seedat S, Govender R, Koch JR, Parry CD. Hazardous and harmful use of alcohol and/or other drugs and health status among South African patients attending HIV clinics. AIDS Behav. 2014;18(3):525–34. https://doi.org/10.1007/s10461-013-0587-9.

    Article  Google Scholar 

  7. Kalichman SC, Simbayi LC, Kaufman M, Cain D, Jooste S. Alcohol use and sexual risks for HIV/AIDS in sub-Saharan Africa: systematic review of empirical findings. Prev Sci. 2007;8(2):141. https://doi.org/10.1007/s11121-006-0061-2.

    Article  PubMed  Google Scholar 

  8. Morojele NK, Kekwaletswe CT, Nkosi S. Associations between alcohol use, other psychosocial factors, structural factors and antiretroviral therapy (ART) adherence among South African ART recipients. AIDS Behav. 2014;18(3):519–24. https://doi.org/10.1007/s10461-013-0583-0.

    Article  PubMed  Google Scholar 

  9. Patterson TL, Semple SJ, Zians JK, Strathdee SA. Methamphetamine-using HIV-positive men who have sex with men: correlates of polydrug use. J Urban Health. 2005;82(1):i120–6. https://doi.org/10.1093/jurban/jti031.

    Article  Google Scholar 

  10. Degenhardt L, Glantz M, Evans-Lacko S, et al. Estimating treatment coverage for people with substance use disorders: an analysis of data from the World Mental Health Surveys. World Psychiatry. 2017;16(3):299–307. https://doi.org/10.1002/wps.20457.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Haldane V, Cervero-Liceras F, Chuah FL, et al. Integrating HIV and substance use services: a systematic review. J Int AIDS Soc. 2017;20(1). https://doi.org/10.7448/IAS.20.1.21585.

    Article  PubMed  PubMed Central  Google Scholar 

  12. World Health Organization. Consolidated guidelines on HIV prevention, diagnosis, treatment and care for key populations—2016 update. Geneva: WHO Press; 2016. http://www.deslibris.ca/ID/10063272. Accessed 26 Apr 2018.

    Google Scholar 

  13. National Department of Health. National consolidated guidelines for the prevention of mother-to-child transmission of HIV (PMTCT) and the management of HIV in children, adolescents and adults. Pretoria: National Department of Health, Republic of South Africa; 2014. http://www.sahivsoc.org/Files/ART%20Guidelines%2015052015.pdf. Accessed 26 Apr 2018.

    Google Scholar 

  14. Parry C, Ferreira-Borges C, Poznyak V, Lönnroth K, Rehm J. The international study on alcohol and infectious diseases: three priorities for research. Addiction. 2013;108(1):1–2. https://doi.org/10.1111/j.1360-0443.2012.04000.x.

    Article  PubMed  Google Scholar 

  15. Magidson JF, Gouse H, Psaros C, Remmert JE, O’Cleirigh C, Safren SA. Task shifting and delivery of behavioral medicine interventions in resource-poor global settings: HIV/AIDS treatment in sub-Saharan Africa. In: Vranceanu A-M, Greer JA, Safren SA, editors. The Massachusetts General Hospital Handbook of Behavioral Medicine: a clinician’s guide to evidence-based psychosocial interventions for individuals with medical illness. New York: Humana Press; 2017. p. 297–320.

    Chapter  Google Scholar 

  16. Magidson JF, Regenauer KS, Andersen LS, Safren SA. Chronic physical diseases. In: Stein DJ, Bass JK, Hofmann SG, eds. Global mental health and psychotherapy: adapting psychotherapy for low- and middle-income countries. London, UK: Academic Press; 2019:259–77. https://doi.org/10.1016/B978-0-12-814932-4.00012-4.

    Chapter  Google Scholar 

  17. World Health Organization (WHO). Task shifting: rational redistribution of tasks among health workforce teams: global recommendations and guidelines. Geneva: WHO; 2008. p. 96. http://www.who.int/healthsystems/TTR-TaskShifting.pdf. Accessed 12 Aug 2018.

    Google Scholar 

  18. Singla DR, Kohrt BA, Murray LK, Anand A, Chorpita BF, Patel V. Psychological treatments for the world: lessons from low-and middle-income countries. Annu Rev Clin Psychol. 2017;13:149–81. https://doi.org/10.1146/annurev-clinpsy-032816-045217.

    Article  PubMed  PubMed Central  Google Scholar 

  19. van Ginneken N, Tharyan P, Lewin S, et al. Non-specialist health worker interventions for the care of mental, neurological and substance-abuse disorders in low-and middle-income countries. Cochrane Database Syst Rev. 2013;(11). https://doi.org/10.1002/14651858.CD009149.pub2.

  20. Magidson JF, Joska JA, Regenauer KS, et al. “Someone who is in this thing that I am suffering from”: the role of peers and other facilitators for task sharing substance use treatment in South African HIV care. Int J Drug Policy. 2019;70:61–9. https://doi.org/10.1016/j.drugpo.2018.11.004.

    Article  PubMed  Google Scholar 

  21. Jack HE, Oller D, Kelly J, Magidson JF, Wakeman SE. Addressing substance use disorder in primary care: the role, integration, and impact of recovery coaches. Subst Abus. 2018;39(3):307–14. https://doi.org/10.1080/08897077.2017.1389802.

    Article  PubMed  Google Scholar 

  22. Bassuk EL, Hanson J, Greene RN, Richard M, Laudet A. Peer-delivered recovery support services for addictions in the United States: a systematic review. J Subst Abuse Treat. 2016;63:1–9. https://doi.org/10.1016/j.jsat.2016.01.003.

    Article  PubMed  Google Scholar 

  23. Myers B, Lund C, Lombard C, et al. Comparing dedicated and designated models of integrating mental health into chronic disease care: study protocol for a cluster randomized controlled trial. Trials. 2018;19(1):185. https://doi.org/10.1186/s13063-018-2568-9.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Wechsberg WM, Ndirangu JW, Speizer IS, et al. An implementation science protocol of the Women’s Health CoOp in healthcare settings in Cape Town, South Africa: a stepped-wedge design. BMC Womens Health. 2017;17(1):85. https://doi.org/10.1186/s12905-017-0433-8.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Curran GM, Bauer M, Mittman B, Pyne JM, Stetler C. Effectiveness-implementation hybrid designs: combining elements of clinical effectiveness and implementation research to enhance public health impact. Med Care. 2012;50(3):217–26. https://doi.org/10.1097/MLR.0b013e3182408812.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. 1999;89(9):1322–7. https://doi.org/10.2105/AJPH.89.9.1322.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  27. King DK, Glasgow RE, Leeman-Castillo B. Reaiming RE-AIM: using the model to plan, implement, and evaluate the effects of environmental change approaches to enhancing population health. Am J Public Health. 2010;100(11):2076–84. https://doi.org/10.2105/AJPH.2009.190959.

    Article  PubMed  PubMed Central  Google Scholar 

  28. Weiss SM, Jones DL, Lopez M, Villar-Loubet O, Chitalu N. The many faces of translational research: a tale of two studies. Transl Behav Med. 2011;1(2):327–30. https://doi.org/10.1007/s13142-011-0044-0.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Jones D, Weiss S, Chitalu N. HIV prevention in resource limited settings: a case study of challenges and opportunities for implementation. Int J Behav Med. 2014. https://doi.org/10.1007/s12529-014-9397-3.

    Article  Google Scholar 

  30. Proctor E, Silmere H, Raghavan R, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Health. 2011;38(2):65–76. https://doi.org/10.1007/s10488-010-0319-7.

    Article  PubMed  Google Scholar 

  31. Haroz EE, Bolton P, Nguyen AJ, et al. Measuring implementation in global mental health: validation of a pragmatic implementation science measure in eastern Ukraine using an experimental vignette design. BMC Health Serv Res. 2019;19(1):262. https://doi.org/10.1186/s12913-019-4097-y.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  32. Western Cape Provincial AIDS Council. Annual progress report 2014/15. South Africa: Western Cape Government; 2016. http://sanac.org.za/wp-content/uploads/2016/04/WC_PSP-ANNUAL-PROGRESS-REPORT-Final.pdf.

    Google Scholar 

  33. Haberer JE, Kahane J, Kigozi I, et al. Real-time adherence monitoring for HIV antiretroviral therapy. AIDS Behav. 2010;14(6):1340–6. https://doi.org/10.1007/s10461-010-9799-4.

    Article  PubMed  PubMed Central  Google Scholar 

  34. Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)—a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42(2):377–81. https://doi.org/10.1016/j.jbi.2008.08.010.

    Article  PubMed  Google Scholar 

  35. WHO ASSIST Working Group. The Alcohol, Smoking and Substance Involvement Screening Test (ASSIST): development, reliability and feasibility. Addiction. 2002;97(9):1183–94. https://doi.org/10.1046/j.1360-0443.2002.00185.x.

    Article  Google Scholar 

  36. Rawson RA, Shoptaw SJ, Obert JL, et al. An intensive outpatient approach for cocaine abuse treatment: the Matrix model. J Subst Abuse Treat. 1995;12(2):117–27. https://doi.org/10.1016/0740-5472(94)00080-b.

    Article  CAS  PubMed  Google Scholar 

  37. Obert JL, McCann MJ, Marinelli-Casey P, et al. The Matrix model of outpatient stimulant abuse treatment: history and description. J Psychoactive Drugs. 2000;32(2):157–64. https://doi.org/10.1080/02791072.2000.10400224.

    Article  CAS  PubMed  Google Scholar 

  38. Safren SA, Otto MW, Worth JL. Life-steps: applying cognitive behavioral therapy to HIV medication adherence - ScienceDirect. Cogn Behav Pract. 1999;6(4):332–41. https://doi.org/10.1016/S1077-7229(99)80052-2.

    Article  Google Scholar 

  39. Lejuez CW, Hopko DR, Acierno R, Daughters SB, Pagoto SL. Ten year revision of the brief behavioral activation treatment for depression: revised treatment manual. Behav Modif. 2011;35(2):111–61. https://doi.org/10.1177/0145445510390929.

    Article  CAS  PubMed  Google Scholar 

  40. Daughters SB, Magidson JF, Anand D, Seitz-Brown CJ, Chen Y, Baker S. The effect of a behavioral activation treatment for substance use on post-treatment abstinence: a randomized controlled trial. Addiction. 2018;113(3):535–44. https://doi.org/10.1111/add.14049.

    Article  PubMed  PubMed Central  Google Scholar 

  41. Marlatt GA, Gordon JR. Relapse prevention: a self-control strategy for the maintenance of behavior change. New York: Guilford; 1985. p. 85–101.

    Google Scholar 

  42. Bowen S, Chawla N, Marlatt GA. Mindfulness-based relapse prevention for addictive behaviors: a clinician’s guide: New York, NY: Guilford Press; 2011.

  43. Andersen LS, Magidson JF, O’Cleirigh C, et al. A pilot study of a nurse-delivered cognitive behavioral therapy intervention (Ziphamandla) for adherence and depression in HIV in South Africa. J Health Psychol. 2018;23(6):776–87. https://doi.org/10.1177/1359105316643375.

    Article  PubMed  Google Scholar 

  44. Magidson JF, Seitz-Brown CJ, Safren SA, Daughters SB. Implementing behavioral activation and life-steps for depression and HIV medication adherence in a community health center. Cogn Behav Pract. 2014;21(4):386–403. https://doi.org/10.1016/j.cbpra.2013.10.002.

    Article  PubMed  PubMed Central  Google Scholar 

  45. Magidson J, Andersen LS, Satinsky E, et al. “Too much boredom isn’t a good thing”: adapting behavioral activation for substance use in a resource-limited South African HIV care setting. Psychotherapy. https://doi.org/10.1037/pst0000257.

  46. Creswell JW, Clark VLP. Designing and conducting mixed methods research. 3rd ed: Thousand Oaks, CA: Sage publications; 2017.

  47. Papas RK, Sidle JE, Gakinya BN, et al. Treatment outcomes of a stage 1 cognitive-behavioral trial to reduce alcohol use among human immunodeficiency virus-infected out-patients in western Kenya. Addiction. 2011;106(12):2156–66. https://doi.org/10.1111/j.1360-0443.2011.03518.x.

    Article  PubMed  PubMed Central  Google Scholar 

  48. Cully JA, Armento MEA, Mott J, et al. Brief cognitive behavioral therapy in primary care: a hybrid type 2 patient-randomized effectiveness-implementation design. Implement Sci. 2012;7:64. https://doi.org/10.1186/1748-5908-7-64.

    Article  PubMed  PubMed Central  Google Scholar 

  49. Proctor EK, Powell BJ, McMillen JC. Implementation strategies: recommendations for specifying and reporting. Implement Sci. 2013;8(1):139. https://doi.org/10.1186/1748-5908-8-139.

    Article  PubMed  PubMed Central  Google Scholar 

  50. Kohrt BA, Jordans MJD, Rai S, et al. Therapist competence in global mental health: development of the ENhancing Assessment of Common Therapeutic factors (ENACT) rating scale. Behav Res Ther. 2015;69:11–21. https://doi.org/10.1016/j.brat.2015.03.009.

    Article  PubMed  PubMed Central  Google Scholar 

  51. Pellowski JA, Kalichman SC, White D, Amaral CM, Hoyt G, Kalichman MO. Real-time medication adherence monitoring intervention: test of concept in people living with HIV infection. J Assoc Nurses AIDS Care. 2014;25(6):646–51. https://doi.org/10.1016/j.jana.2014.06.002.

    Article  PubMed  PubMed Central  Google Scholar 

  52. Musiimenta A, Atukunda EC, Tumuhimbise W, et al. Acceptability and feasibility of real-time antiretroviral therapy adherence interventions in rural Uganda: mixed-method pilot randomized controlled trial. JMIR Mhealth Uhealth. 2018;6(5):e122. https://doi.org/10.2196/mhealth.9031.

    Article  PubMed  PubMed Central  Google Scholar 

  53. McNabb J, Ross JW, Abriola K, Turley C, Nightingale CH, Nicolau DP. Adherence to highly active antiretroviral therapy predicts virologic outcome at an inner-city human immunodeficiency virus clinic. Clin Infect Dis. 2001;33(5):700–5. https://doi.org/10.1086/322590.

    Article  CAS  PubMed  Google Scholar 

  54. Arnsten JH, Demas PA, Grant RW, et al. Impact of active drug use on antiretroviral therapy adherence and viral suppression in HIV-infected drug users. J Gen Intern Med. 2002;17(5):377–81. https://doi.org/10.1046/j.1525-1497.2002.10644.x.

  55. Arnsten JH, Demas PA, Farzadegan H, et al. Antiretroviral therapy adherence and viral suppression in HIV-infected drug users: comparison of self-report and electronic monitoring. Clin Infect Dis. 2001;33(8):1417–23. https://doi.org/10.1086/323201.

    Article  CAS  PubMed  Google Scholar 

  56. Rounsaville BJ, Carroll KM, Onken LS. A stage model of behavioral therapies research: getting started and moving on from stage I. Clin Psychol Sci Pract. 2001;8(2):133–42. https://doi.org/10.1093/clipsy.8.2.133.

    Article  Google Scholar 

  57. Allen J, Linnon L, Emmons K. Fideity and its relationship to implementation effectiveness, adaptation, and dissemination. In: Brownson R, Colditz G, Proctor, editors. Dissemination and implementation research in health. New York: Oxford University Press; 2012.

    Google Scholar 

  58. Pope C, Mays N. Qualitative research in health care. 3rd ed: Malden, MA: BMJ Publishing Group: BMJ Books; 2006.

  59. Myers B, Petersen-Williams P, van der Westhuizen C, et al. Community health worker-delivered counselling for common mental disorders among chronic disease patients in South Africa: a feasibility study. BMJ Open. 2019;9(1):e024277. https://doi.org/10.1136/bmjopen-2018-024277.

    Article  PubMed  PubMed Central  Google Scholar 

  60. Silverman D. Doing qualitative research: a practical handbook. 3rd ed. California: Sage; 2010.

    Google Scholar 

  61. Magidson JF, Iyer HS, Regenauer KS, et al. Recreational ART use among individuals living with HIV/AIDS in South Africa: examining longitudinal ART initiation viral suppression. Drug Alcohol Depend. 2019:198:192–8. https://doi.org/10.1016/j.drugalcdep.2019.02.009.

    Article  PubMed  PubMed Central  Google Scholar 

  62. Ahmat A, Bilal N, Herbst CH, Weber SE. How many health workers? The labor market for health workers in Africa: a new look at the crisis, vol. 14. Washington, DC: World Bank; 2013. p. 317.

    Google Scholar 

Download references

Acknowledgements

We would like to acknowledge the rest of the Project Khanya team, including but not limited to Nonceba Ciya, Neliswa Kotelo, Sibabalwe Ndamase, Alexandra Rose, Emily Satinsky, Courtney Colgan, Valerie Braddick, Frances Loeb, Hannah Tralka, Christine Wan, and Morgan Anvari. We would also like to thank the study participants for their time, input, and contributions to this study.

Funding

This study is funded by the National Institute of Drug Abuse (NIDA; K23DA041901; PI: Magidson). Dr. Safren’s time on this manuscript was supported by K24DA040489 (PI: Safren). Dr. Lena Andersen’s time on this manuscript was supported by the National Institute of Mental Health (NIMH) grant R01MH103770.

Author information

Authors and Affiliations

Authors

Contributions

JFM conceptualized the project idea and secured funding for this project with SAS, JAJ, and BM, and JFM led all aspects of the project and write-up of this manuscript with JMB and KSR. JAJ, BM, and SAS provided JFM guidance on all aspects of conceptualizing and leading this project, including this write-up. JMB and KSR were major contributors in writing the manuscript, and JMB led the data management. KSR and SM coordinated all aspects of this study under the mentorship of JFM and LSA. CO provided the input on conceptualizing the study protocol and provided ongoing guidance on design considerations and study procedures. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Jessica F. Magidson.

Ethics declarations

Ethics approval and consent to participate

This study was approved by the University of Cape Town Human Research Ethics Committee (UCT HREC; REF: 187/2018; initial approval April 18, 2018; latest approval of the most recent protocol was June 24, 2019). The UCT HREC is the primary Institutional Review Board (IRB) of record. The IRB at the University of Maryland, College Park, has agreed to rely on the UCT HREC for continuing ethics oversight using an IRB/Independent Ethics Committee (IEC) IRB Authorization Agreement (IAA; approved June 11, 2018). The current protocol version is Version 6, approved June 24, 2019.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Additional file 1.

SPIRIT Checklist.

Additional file 2.

Schedule of enrollment, intervention, and assessments.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Magidson, J.F., Joska, J.A., Myers, B. et al. Project Khanya: a randomized, hybrid effectiveness-implementation trial of a peer-delivered behavioral intervention for ART adherence and substance use in Cape Town, South Africa. Implement Sci Commun 1, 23 (2020). https://doi.org/10.1186/s43058-020-00004-w

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s43058-020-00004-w

Keywords