Skip to main content

Adapting and scaling a proven diabetes prevention program across 11 worksites in India: the INDIA-WORKS trial

Abstract

Background

Structured lifestyle change education reduces the burden of cardiometabolic diseases such as diabetes. Delivery of these programs at worksites could overcome barriers to program adoption and improve program sustainability and reach; however, tailoring to the worksite setting is essential.

Methods

The Integrating Diabetes Prevention in Workplaces (INDIA-WORKS) study tested the implementation and effectiveness of a multi-level program for reducing cardiometabolic disease risk factors at 11 large and diverse worksites across India. Herein, we describe and classify program adaptations reported during in-depth interviews and focus group discussions with worksite managers, program staff, and peer educators involved in program delivery, and program participants and drop-outs. We used thematic analysis to identify key themes in the data and classified reported program adaptations using the FRAME classification system.

Results

Adaptations were led by worksite managers, peer educators, and program staff members. They occurred both pre- and during program implementation and were both planned (proactive) and unplanned (proactive and reactive). The most frequently reported adaptations to the individual-level intervention were curriculum changes to tailor lessons to the local context, make the program more appealing to the workers at the site, or add a wider variety of exercise options. Other content adaptations included improvements to the screening protocol, intervention scheduling, and outreach plans to tailor participant recruitment and retention to the sites. Environment-level content adaptations included expanding or leveraging healthy food and exercise options at the worksites. Challenges to adaptation included scheduling and worksite-level challenges. Participants discussed the need to continue adapting the program in the future to continue making it relevant for worksite settings and engaging for employees.

Conclusion

This study describes and classifies site-specific modifications to a structured lifestyle change education program with worksite-wide health improvements in India. This adds to the literature on implementation adaptation in general and worksite wellness in India, a country with a large and growing workforce with, or at risk of, serious cardiometabolic diseases. This information is key for program scale-up, dissemination, and implementation in other settings.

Trial registration

Clinicaltrials.gov NCT02813668. Registered June 27, 2016

Peer Review reports

Background/introduction

At least 101 million and 136 million people in India have diabetes or prediabetes, respectively, many of whom are working age adults [1]. Diabetes profoundly impacts health systems (e.g., resources for care), individual and family finances (e.g., care costs, loss of wages due to lost work time), individuals (e.g., debilitating secondary complications, lower quality of life), and worksites (e.g., lower productivity, lost work time) [2,3,4,5]. Lifestyle interventions are structured education programs for weight loss, increasing healthy lifestyle behaviors, improving cardiovascular risk factors, delaying the onset of diabetes in at-risk individuals, and/or preventing secondary complications and reducing medication use in individuals with diabetes [6,7,8,9,10,11,12,13,14,15,16]. Lifestyle interventions have been shown to be efficacious and effective [17,18,19,20]. However, real-world implementation is challenging because existing programs require large upfront investments of money and staff and participant time with returns on investments only recouped over years [21].

Delivering lifestyle interventions at worksites, using the existing structure of worksite health facilities for testing and utilizing employees as peer educators, could be an effective and cost-effective approach for delivering lifestyle change education. Furthermore, it may overcome many individual-level barriers to participation in a lifestyle change program (e.g., lack of time and social support, inability to locate resources) and could be beneficial to employers (e.g., higher employee satisfaction and retention; less lost productivity) [22,23,24,25,26,27]. To be successfully implemented and scaled, evidence-based interventions need to be adapted to succeed in the context where delivered [28]. Translation of evidence-based interventions to the broader population requires adaptations for delivery in community settings that lower financial and personnel costs and increase the acceptability and appropriateness of the program for participants, cost-effectiveness for payers, and program scalability and sustainability. Program modifications are changes made to interventions either deliberately or in response to challenges arising during implementation. Adaptations, a type of program modification, are deliberate program changes made to improve the program’s update, delivery, effectiveness, or acceptability in a particular context [29, 30]. Documenting these adaptations, particularly those that occur after program implementation begins, is crucial to understanding how to adapt real-world programs across settings [31, 32]. Exploring these program changes will provide key information for others seeking to implement worksite-based interventions for cardiometabolic conditions, particularly in India, where there is a large and growing need for effective, community-based programming to overcome barriers to chronic disease prevention.

Herein we report on the adaptations made during the Integrating Diabetes Prevention in Workplaces (INDIA-WORKS, Clinicaltrial.gov, NCT02813668, registered on June 27, 2016, https://classic.clinicaltrials.gov/ct2/show/NCT02813668) implementation study. INDIA-WORKS aimed to overcome barriers to worksite delivery of lifestyle interventions by using the peer educator model while promoting worksite-based environmental changes to support program participants. We applied the FRAME [30] classification system, a tool for documenting and categorizing program modifications and adaptations in implementation programs and research studies, to describe program changes across worksites.

Methods

Study setting—the INDIA-WORKS study

The INDIA-WORKS intervention was based on the lifestyle education program tested in the Diabetes Community Lifestyle Improvement Program (D-CLIP) trial [33]. D-CLIP was a randomized controlled translation research study testing the effectiveness, acceptability, and cost-effectiveness of a lifestyle change curriculum based on the U.S. Diabetes Prevention Program (DPP) [14, 34] plus the addition of metformin as needed for reducing diabetes risk in overweight or obese Indian adults with pre-diabetes. The D-CLIP curriculum included 4 months of weekly, group-based classes on making healthy dietary changes, increasing physical activity, building social support, and overcoming barriers followed by 2 months of classes on maintaining lifestyle changes. The D-CLIP intervention reduced diabetes incidence and improved cardiometabolic risk factors [17]. The D-CLIP curriculum, including lesson plans, handouts, and coach scripts, were modified for the INDIA-WORKS program as described below and in the results. INDIA-WORKS participants were not provided metformin as part of the study. The INDIA-WORKS study sought to test the application of the D-CLIP program for broader prevention of cardiovascular disease by delivering the program to individuals with both prediabetes and unmedicated diabetes.

INDIA-WORKS was a pre-post design, implementation research study conducted at 11, medium to large worksites (1500–50,000 employees) across ten companies in South, Central, and East India. Worksites were diverse and included mineral-based and product manufacturing, energy, technology, and transportation industry worksites. All sites included a variety of workers in manual labor and office-based positions. Inclusion criteria for employees to participate in the intervention classes were age ≥ 18 years; overweight or obese using World Health Organization defined South-Asian cut-points: BMI ≥ 23 to < 27.5 kg/m2 (overweight), BMI ≥ 27.5 kg/m2 (obese), and/or waist circumference ≥ 90 cm for men and ≥ 80 cm for women [35]; have prediabetes (HbA1c of 5.7–6.4%) or diabetes (HbA1c ≥ 6.5%); not currently taking any diabetes medications; not pregnant or breastfeeding; and without history of heart disease, current serious illness, or conditions impeding participation in an unsupervised physical activity and diet change program. Eligible individuals were identified using a two-phased screening program at each worksite. Multi-stage screening activities were conducted over multiple days at the worksite to minimize time away from work for employees and avoid unnecessary testing for ineligible individuals. Study testing was conducted in collaboration with worksite health clinics, which are staffed by nurses and physicians who provide routine healthcare for the workers at each site. Individuals with newly identified or uncontrolled disease (e.g., diabetes, hypertension or dyslipidemia) were referred to the onsite physicians.

The multi-level intervention package included both a structured lifestyle change program (individual-level) and supportive changes to the worksite environment (environmental-level). The individual-level intervention was designed to benefit employees enrolled in the lifestyle change program, while work environment changes could benefit all employees. The intervention package included core components which remained standard across sites and adaptable elements which could be modified to suit individual worksite settings. Core components were (1) key design features of the DPP lifestyle change program [34], the basis for D-CLIP and subsequently the INDIA-WORKS curriculums; (2) features shown to be important for user acceptability in the D-CLIP study; or (3) components recommended by worksite advisors during program planning. Table 1 describes the planned core components and adaptable elements of the intervention package.

Table 1 INDIA-WORKS planned core components and adaptive elements

Data collection

Adaptations to the INDIA-WORKS curriculum and delivery were identified and described through qualitative interviews (individual in-depth interviews [IDIs] and focus group discussions [FGDs]) with individuals involved in the delivery, management, and use of the INDIA-WORKS program. IDIs explored the individual level experiences of high-level worksite managers (n = 16), peer educators (n = 29), program drop-outs (n = 29), and INDIA-WORKS team members involved in on-site program implementation (n = 8). FGDs (n = 14) with program participants who completed the program described community-level experiences of the program. IDI and FGD guides covered program views, context-specific program adaptations and their challenges, and suggestions for sustaining the program. Qualitative data collection occurred during the first year of the INDIA-WORKS study (December 2018–June 2019). IDI/FGD participants were recruited via a gatekeeper strategy. We first discussed the purpose and data collection procedures with managers and requested their permission and support for the data collection. We included participants suggested by managers as well as individuals identified by local study staff in our pool of potential interviewees to ensure a diverse and information-rich sample for the qualitative data. Potential IDI/FGD participants were approached via email, phone call, and/or in-person contact.

IDIs/FGDs were conducted privately by a trained member of the INDIA-WORKS study team at a private location at the participant’s worksite in their preferred language (English, Hindi, Malayalam, or Tamil). Participants participated in only one FGD or IDI. For manager interviews and INDIA-WORKS staff interviews, interviewers had been in contact with the interviewees; however, care was taken to ensure that interviews with staff were not done by that person’s supervisors. For all other IDIs/FGDs, there was no prior relationship between the interviewer and interviewees. Participants provided written informed consent for the interview and audio-recording of the discussion; as part of the consent process, the goals of the qualitative data collection and reasons for the research were described to participants. Interview team training covered interview and FGD moderation techniques, reflexivity, and the data collection tools. The interview team met at least once per week to review data quality and assess data saturation. Saturation was determined when (1) there was sufficient diversity in participants recruited and experiences shared; (2) different types of worksites were included; and (3) data saturation was observed, whereby the interview team assessed that no new issues were being reported. When these requirements were fulfilled, code saturation was reached and data collection ceased [36].

The discussions were guided using semi-structured IDI/FGD guides, which were informed by the D-CLIP study [33] and Proctor’s framework [37, 38] and made culturally appropriate for the target individuals and setting. Guides were pilot tested internally by conducting practice interviews with team members and in the field in each language, refined, and translated before study use. FGDs and IDIs audios were digitally-recorded, transcribed verbatim, and translated into English. Translated transcripts were checked for accuracy of translation. To enable comparisons between subsets of those interviewed (e.g., different sexes), demographic information was collected.

Data analysis

Translated, verbatim transcripts of the IDIs and FGDs were managed using MAXQDA 2020 (VERBI Software). Using thematic analysis techniques, a codebook including both deductive and inductive codes for each set of qualitative data (e.g., peer educator IDIs, FGDs with program participants) was created. Three coders coded the data which involved assessing inter-coder agreement, rectifying discrepancies in coding, and then coding transcripts independently. Four codes, “Adaptations”, “IW Worksite Context”, “Sustainability”, and “Future Suggestions/Adaptations” described program adaptations and detailed suggested adaptations for the future. These codes were the focus of this analysis.

Coded segments were reviewed and a thick description of each code was developed describing adaptations to the INDIA-WORKS curriculum, worksite environmental changes, changes to improve program acceptability, challenges to program adaptation, and suggestions for additional changes for the future. Modifications and adaptations were then categorized and described by applying the FRAME [30], a comprehensive tool for describing programmatic adaptations in implementation science. The FRAME categorizes adaptations and modifications using the following domains:

  1. (1)

    What was modified

  2. (2)

    The level of the modification—here, individual-level or environmental-level

  3. (3)

    The nature, or type, of the modification—e.g., tailoring, refining, adding elements

  4. (4)

    The goal of and reason for the modification

  5. (5)

    When the modification was made—pre-implementation or during implementation

  6. (6)

    If the modification was planned or unplanned and proactive or reactive

  7. (7)

    Who participated in the decision to make the modification—here, reported as the specific players, INDIA-WORKS staff, worksite managers, and peer educators, which are included in the following FRAME categories for this domain: INDIA-WORKS staff includes treatment/intervention team, program developers and purveyors, and individual practitioners/facilitators; peer educators are individual practitioners/facilitators; and worksite managers are administration

  8. (8)

    If the modification was fidelity consistent

In addition, we described challenges to adapting the program at the worksite and suggestions for future program adaptations. Results were shared and discussed with members of the study team involved in field work; due to challenges of the COVID-19 pandemic at the worksites, it was not feasible to review findings and interpretations with worksite interviewees.

Results

Program adaptations were made at worksites before and during the first year of project implementation. Worksite managers, peer educators, and INDIA-WORKS staff members all reported making program adaptations to ensure successful program delivery at individual worksites. Adaptation were fidelity-consistent, unless otherwise noted, reflecting modifications to adaptable, and not core, components of the intervention package. Herein, we report on cohort-level adaptations to the individual-level intervention content including adaptations to study curriculum or testing and those made at the environment-level and affecting all participants at that site. For each, we map the adaptations to FRAME components (Tables 2 and 3), providing illustrative examples in the text. In addition, we report on adaptations to training.

Table 2 Content-level adaptations to the INDIA-WORKS program
Table 3 Organization-level adaptations to the INDIA-WORKS program

Adaptations to the individual-level intervention

Content adaptations affected the individual-level intervention and included changes to the program curriculum as well as tailoring program and testing logistics to make the program more understandable and approachable for program participants (Table 2).

Adaptations to the INDIA-WORKS curriculum

The most discussed adaptations were to the curriculum. Managers, peer educators, and INDIA-WORKS staff all discussed the importance of presenting the curriculum in a way that is understandable and relatable to the worksite employees. Adaptations included planned changes pre-intervention (e.g., translating to the local language) and reactive adaptations implemented during the program to improve program acceptability and participant engagement (e.g., reducing technical language). Peer educators and INDIA-WORKS staff tailored examples and dietary advice to local diets, focusing on eating smaller servings of foods that were familiar to participants to improve participant acceptability. A few peer educators also felt that local diets were the best suited for disease prevention and health. As one Peer Educator shared: “suppose I was born and brought up in a Chattisgarhi family and since my birth, whole time my three meals are only rice and rice and rice. This is never going to harm me … your body is adjusted to that type of diet”. A couple of peer educators made additional adaptations in the lifestyle classes they led based on personal views; for example, adding breathing exercises to reduce stress or moving the order of lessons to focus first on physical activity then on diet. This last example was not consistent with the class curriculum, reflecting a lack of fidelity to the program.

Several sites expanded the exercise program during implementation to add more advanced options like more intensive aerobics, Zumba, or yoga classes. Zumba classes were particularly well received by INDIA-WORKS participants (“Everyone likes to dance, but no one wants to do exercise. But when it is merged into one, everyone is interested”. Peer Educator). Some worksites refined the physical activity curriculum to provide additional training on skills they felt participants were lacking. This included helping participants to dress in proper exercise clothing and shoes for comfort and safety, focusing on proper breathing techniques when exercising, proper stretching to decrease pain and soreness, and being more active in their daily lives.

Adaptations to program and testing logistics

To increase overall program acceptability, sites adapted the program to improve testing uptake, recruitment, and retention. INDIA-WORKS staff members reported applying lessons learned at initial screening and testing visits to testing at subsequent worksites (unplanned, reactive adaptation); for example, collecting blood samples and follow-up data at a single study visit instead of multiple visits improved data completion. One worksite expanded study testing to better monitor program success by funding HbA1c and exercise testing for all participants.

Worksites sought to improve enrollment and retention by making the classes appealing to employees. Classes were held at times convenient for participants and permissible to supervisors. Classes at some sites were held during work hours, but most worksites (“90 percent” INDIA-WORKS staff) held classes after work hours. When this was challenging for participants, some worksites agreed to allow participants 30 min at the end of the workday for classes. At sites with shift workers, class times changed as participants’ shifts changed. INDIA-WORKS staff worked with management to select the most convenient venue for classes to improve participation and noted that different locations yielded better, or worse, class attendance. Although class scheduling was a planned adaptation, worksites had to continue making reactive/unplanned changed to class times and locations to find the ideal class time for different workers at the site.

Other sites sought to increase enrollment proactively by making the program more appealing to participants or widening eligibility criteria for some or all intervention components. One manager described how the program was presented as a way to reduce risk factors instead of labeling participants: “When you tell the participants…‘you are a pre-diabetic, you are a hypertensive, you are a diabetic’, they feel offended. They feel bad. They feel depressed. …we say, “You are a high-risk individual. There is goal for improvement”. (Worksite Manager). Another worksite hired retired local doctors to promote the program. Other sites allowed non-eligible workers to participate in some program components (e.g., lifestyle or exercise classes) but not study testing.

During program implementation, worksites made reactive adaptations to improve participant retention. Across sites, peer educators and INDIA-WORKS staff, and at some worksites managers, reported calling or messaging (via text or WhatsApp) participants to remind them of class, schedule sessions, or reschedule makeup sessions when conflicts arose. Makeup sessions, either newly scheduled sessions, one-on-one classes, or allowing participants to join another group for that week, were commonly employed to ensure that participants covered the course material even when their work schedules changed or required them to miss a class. For workers facing the most barriers (see Challenges to Adaptation), lessons were delivered individually at participants’ desks.

Adaptations to the environmental-level intervention

Organization-level adaptations are shown in Table 3. While changes to the worksite canteens were all planned/proactive and pre-implementation, worksite-level changes to physical activity resources and health programming were both planned and unplanned and occurred both pre- and during implementation. Managers reported that making environmental changes at the worksite required them to consider both health recommendations and worker preferences to increase acceptability and avoid push-back. For example, one manager described how canteen changes needed a balanced approach instead of drastic changes: “Simply only giving diet biscuit… people will become mad” and less healthy foods (e.g., fried foods) need to be offered “once in a while”. A few sites created new print materials (e.g., posters) to reinforce the messages taught in the INDIA-WORKS classes (reading nutrition labels, proper portion sizes) and posted them in common areas. Another site provided nutrition information for canteen foods.

Many sites leveraged existing health promotion programming to provide INDIA-WORKS participants and other workers guidance on healthy lifestyles, disease prevention, and disease management. Several sites regularly invited experts (including INDIA-WORKS investigators) to present on health-related topics. Other sites discussed health issues or reviewed worker health statistics at team meetings. One worksite has an extensive health library including digital educational tools and a health educator available to all workers as well as a health statistician, psychologist, and other health providers on staff. One worksite, an occupational health industry, prioritized health programming (twice monthly screening camps, regular health talks, quarterly diabetes camps); INDIA-WORKS was easy to integrate and peer educators felt their roles in the INDIA-WORKS program were “part of job. That’s all. See we are here to prevent”. (Peer Educator).

Training program-level adaptations

Most worksites delivered the INDIA-WORKS training program for peer educators without adaptations. Only one worksite hosted additional trainings sessions for peer educators to help them master the material and improve comfort with teaching. At all sites, INDIA-WORKS staff providing on-going support and training. One INDIA-WORKS staff shared: “This is a completely new forte for them. I won’t be able to do their job if I am asked to. I might do it if you explain to me well enough... Some [peer educators] would even come to our rooms and ask us how to present a certain thing etc. We gave individual attention to everyone”.

Challenges to program adaptation

Scheduling (and rescheduling) classes around participant schedules, travel time to and around the worksite, production deadlines, and shift work was a “Herculean task” (Worksite Manager) and was discussed more frequently than any other adaptation barrier and across interview participant type. Similarly, sites with multiple worksites or a diversity of employee roles/positions found it challenging to find convenient schedules for classes and noted that program champions and staff had to gain support from management at each site or unit.

Interviewees also noted that the teaching ability, confidence to lead, and dedication of the peer educators varied greatly across sites. For example, at one site, peer educators often did not turn up for classes they were assigned to lead, leaving INDIA-WORKS staff to coach participants, while at another worksite, peer educators engaged in teaching classes and leveraged the INDIA-WORKS staff to provide assistance with more complex lessons and tailor class scripts to the health literacy and education level of workers in their classes.

Concurrent with INDIA-WORKS (but starting before COVID-19-related disruptions), several worksites were affected by major organization-level challenges such as privatization and a company shut down, which made it more difficult to adapt and deliver the INDIA-WORKS program. These challenges resulted in a lack of funds for implementation of environmental-level interventions like canteen changes and difficulty prioritizing the individual-level intervention for managers and participants. In addition, workers’ reactions to these challenges affected how peer educators, INDIA-WORKS staff, and managers were able to adapt the program at their worksites. For example, at one worksite where plans to privatize the worksite were being implemented, some employees at the site blamed the walking patterns of the INDIA-WORKS participants:

[INDIA-WORKS participants] were regularly doing the exercises by walking around the building. Once the privatization issue came up, people started blaming the lack of orders on this walking routine around the building. So the person in charge told me to avoid walking around the building and to walk on one side instead. This was based on the superstition that if one walks around a building, it causes a negative effect. So that caused people to lose their heart a little. INDIA-WORKS staff

Suggestions for future program adaptations

Interview participants suggested additional content adaptations to consider in the future to improve sustainability and scalability of the lifestyle change program. Participants felt continued adaptations would be beneficial including timing and location of classes, variety of exercise types, and widening inclusion criteria. Interviewees suggested expanding the curriculum content by including additional diet and activity advice, information on worksite specific hazards (e.g., noise pollution, dust), and more audio-visual materials. Peer educators, staff, and managers suggested that the class scripts will need periodic updates to make them fresh and appealing to workers: “things keep on changing. So, you should also keep on changing”. (Worksite Manager).

Participants were conflicted about optimal timing and length for the program. Several peer educators and INDIA-WORKS completers suggested that longer or more frequent class periods were needed to cover all the material, provide individual feedback to participants, and do exercise classes, which were especially well received by people in their cohorts. Other interview participants suggested a shorter program (e.g., less or shorter sessions, half/full day classes taught over two days, monthly classes); these interviewees felt that shorter classes would improve participants’ attention and learning: “They come. They sleep. They fiddle the phone. You know attention span is maximum fifteen twenty minutes.… And in this small session, is only a small gathering. so, everybody is interactive”. (Worksite Manager).

Other suggestions mentioned by peer educators and INDIA-WORKS staff focused on creating an environment that enabled Peer Educator success. Suggestions included scheduling classes around peer educators’ time first and expanding the training program for peer educators to include more role playing, visual examples, and additional training on lecturing/teaching to help them feel better prepared to lead classes.

Discussion

Integrated innovation theory posits that in order for an intervention to be successful in complex situations like community settings, it must integrate scientific/technological, social, and business innovations [39]. INDIA-WORKS fulfills this requirement: It delivers scientific innovations (proven lifestyle change education programs with text message supports during maintenance) with social innovations (trained peer health educators delivering a program to a large at risk population) and business innovation (worksite stakeholder commitment and partnering researchers to help deliver the program with fidelity, improve the workplace health environment, and evaluate the model). The packaging of individual lifestyle education with environmental changes at the worksite level, implemented through an academic-industry partnership, is rarely done, particularly in India, a population with acutely high risk for diabetes and diabetes-related complications. If successful, INDIA-WORKS could provide a model for innovative delivery of lifestyle education.

INDIA-WORKS program adaptations included changes to the curriculum, recruitment or retention plans, and creation or use of health programming and resources at the worksites. The majority of adaptations were done during implementation to respond to the needs of the participants and worksite, although adaptations like language translation and changes to worksite exercise and food environments where adapted pre-implementation. Most adaptations were planned, reflecting the large number adaptable components in INDIA-WORKS. Unplanned adaptations occurred in reaction to unanticipated challenges with study recruitment, retention, and classroom logistics due to worksite-specific barriers or challenges. Other unplanned adaptations, such as adding additional cultural adaptation to diet lessons or new types of physical activity, where made in reaction to requests and interests of program participants. Participants’ requesting additional physical activity options might reflect improvements in fitness, as increased fitness can lead individuals to engage in a wider variety of exercise types [40].

Except in one case (where a peer educator changed the order of lessons), adaptations were fidelity-consistent. This may have occurred because the program was carefully designed and presented to study partners with clearly defined core components, those necessary to program fidelity and aligned with proven behavioral health theories or strongly associated with program success in prior studies, and adaptable components which could be changed to be responsive and appropriate to the needs of the individual worksites [41]. This is vital to program success because a program that has been changed in a way that affects components associated with efficacy is doomed to fail even if delivered at the highest quality and consistency [42].

All key players in overseeing program implementation were empowered to adapt program components. Adaptations by peer educators involved the program curriculum or participant retention, items which interfaced directly with participants, while INDIA-WORKS staff focused on adaptations necessary to the conduct of the study at each setting including tailoring of curriculum and recruitment methods to best suit the worksite environment and workers. Manager-led adaptations were often in areas requiring higher-level approvals and coordination (e.g., changes in the canteen, deciding when and where lifestyle classes could be held). In Weiner, Lewis, and Linnan’s theory of the organizational determinants of effective program implementation at worksites, the authors argue that the complexity of implementing projects at worksites require active participation by both management and employees [42]. Other studies support this by showing that buy-in from management and employees was key to worksite program success or lack thereof [43,44,45].

Although, delivering a diabetes prevention program at worksites in India at no monetary cost to the employee can overcome many of the barriers to lifestyle change (e.g., cost of classes, lack of time, inability to locate acceptable resources for weight loss), interview participants still described barriers to adapting the program to the worksites. These included unanticipated worksite changes and disruptions, the ongoing challenge of scheduling and rescheduling classes, and diversity of employees, which have been reported as barriers to worksite health programming in other studies [44, 46, 47]. Suggestions for future program adaptations sought to overcome these challenges and often expanded on the themes identified and adapted during the INDIA-WORKS study. Interview participants shared the need to continue adapting and expanding the program to add interest and variety, better respond to worksite specific challenges, and enable more workers to participate in the program.

This study adds to the limited literature using the FRAME to describe program adaptations and modifications in the Indian context. Although the FRAME was able to categorize and describe most modifications with sufficient detail and clarity, there were some challenges to using the framework. Although various players were involved in suggesting program adaptations, implementation of adaptations always involved the worksite managers, with curriculum changes being the exception (those leading classes or trainings, peer educators and INDIA-WORKS staff, were able to make these adjustments independently). India remains strongly hierarchal, and worksites reflect this top-down model [48]. Managers expect to make the final decisions and workers defer to supervisors. Because of this, the FRAME domain “who made the decision to modify” may not accurately collect information on those involved in the decision to make modifications, since the final choice was often made at the management level. Furthermore, because of this hierarchy, it is possible that some participants were reluctant to report adaptations that were made but not approved by management, meaning that some modifications might not have been captured.

There was also additional challenges in categorizing some of the modifications because of lack of clarity with definitions in the FRAME documentation. For example, we categorized adaptations to program recruiting and retention activities and scheduling of classes as content modifications because they related to the way the treatment (e.g., intervention activities including screening and testing) was delivered. Furthermore, these adaptations were not related to any of the categories of contextual modifications described in the FRAME (format, setting, personnel, or population). In practice, use of the FRAME to document and monitor program adaptations by worksites would be even more challenging, given lack of training and experience in implementation sciences.

Finally, it was both time and resource intensive to document and categorize adaptations in detail and over time. To ensure we understood the full extent of adaptations, we conducted interviews with an array of key players involved in program implementation, and we continued interviews until data saturation was met. Each interview was then transcribed and coded, and thick descriptions were developed before categorizing the data using FRAME. This work was feasible given that this was a large, National Institutes of Health-funded study; however, less resourced study teams or community-based evaluators may not be able to commit to work of this scope to properly document program modifications and adaptations, leading to additional gaps in the literature on real-world implementation of health programs. Additional methodological development is needed to understand how to efficiently document program adaptations on an ongoing basis and how to best use this information to continuously improve interventions during implementation.

This manuscript describing adaptations to the INDIA-WORKS intervention program has several notable strengths. Although there is tremendous growth in the number of community-based interventions, reporting of program adaptations is still limited and often done non-systematically [49, 50]. Adaptations at INDIA-WORKS worksites were driven by individuals working at the site or doing in-field implementation work, instead of researchers, allowing a real-world assessment of adaptations at the study sites. In addition, although India has the second-largest workforce in the world [51], there is limited literature on worksite-based wellness programs in this setting, which is particularly important given the size and diversity of the workforce [52] as well as the large and growing number of individuals at working ages who are affected by cardiometabolic diseases in India [53,54,55]. The application of the FRAME allows for systematic reporting of the adaptations as well as enabling comparison with other studies of intervention adaptations.

However, the FRAME did not guide data collection. Instead, the framework was applied during data analysis to capture information on modifications emerging in the data. This could result in missing data including not all modifications being identified or fully characterized. Similarly, using IDIs only to track adaptations might lead to underreporting of program changes. Future studies of this type should consider using the FRAME and mixed methods data collection systematically to describe and track adaptations in real time. Similarly, although we interviewed a variety of stakeholders involved in the program implementation, including program delivery personnel, managers, and participants, the qualitative data collection was not focused primarily on understanding adaptations, and all worksite-specific changes might not have been captured.

Lastly, we did not explore how specific modifications and adaptations influenced implementation success and intervention effectiveness. The COVID-19 pandemic precluded further qualitative data collection at sites and made collection of additional information from the already-overburdened worksites practically impossible (e.g., adding new worksheets for managers to document additional changes was determined to be too challenging given that managers were already dealing with adapting the worksites to protect workers from COVID-19 transmission). Future studies should evaluate various adaptations for improving participation, retention, program delivery, and indicators of program effectiveness like weight loss. However, there is still great value in reporting program modifications. Very little is known about how programs are adapted in general and in low -and middle-income countries and worksites, specifically. This study goes beyond simply describing planned program methods to provide important guidance on how the program was delivered at individual worksites. This information can be used to help with program scaling and guide other researchers and program planners designing similar programs. Documenting unplanned modifications is particularly important as they can be proactively considered in the future to ensure all adaptation are fidelity consistent. Similarly, this work can be used to help with the design and planning of worksheets and other documentation for recording adaptations and provides documentation to assist in manualizing the intervention for broader dissemination (e.g., examples of adaptable elements, forms for documenting program fidelity).

Conclusion

In conclusion, this manuscript describes and characterizes, using the FRAME classification system, worksite specific adaptations to the INDIA-WORKS intervention. Sites reported adaptations to the curriculum, participant recruitment and retention, and worksite health resources. This study adds to the growing literature reporting on program adaptations in implementation research in general and is one of the first to specifically describe implementation of lifestyle programs for early identification of non-communicable disease and prevention of cardiometabolic disorders at worksites in India.

Availability of data and materials

The dataset (de-identified transcripts of the IDIs and FGDs) analyzed during the current study are available from the corresponding author on reasonable request.

Abbreviations

BMI:

Body mass index

D-CLIP:

Diabetes Community Lifestyle Improvement Program

FGD:

Focus group discussion

FRAME:

Framework for Reporting Adaptations and Modifications-Enhanced

HbA1c:

Glycated hemoglobin

IDI:

In-depth Interview

INDIA-WORKS:

Integrating Diabetes Prevention in Workplaces

References

  1. Anjana RM, Unnikrishnan R, Deepa M, Pradeepa R, Tandon N, Das AK, et al. Metabolic non-communicable disease health report of India: the ICMR-INDIAB national cross-sectional study (ICMR-INDIAB-17). Lancet Diabetes Endocrinol. 2023;11(7):474–89.

    Article  PubMed  Google Scholar 

  2. Abegunde DO, Mathers CD, Adam T, Ortegon M, Strong K. The burden and costs of chronic diseases in low-income and middle-income countries. Lancet. 2007;370(9603):1929–38.

    Article  Google Scholar 

  3. American Diabetes Association. Economic costs of diabetes in the U.S. in 2012. Diabetes Care. 2013;36(4):1033–46.

    Article  PubMed Central  Google Scholar 

  4. Kumpatla S, Kothandan H, Tharkar S, Viswanathan V. The costs of treating long term diabetic complications in a developing country: a study from India. JAPI. 2013;61:102–9.

    PubMed  Google Scholar 

  5. International Diabetes Federation. IDF diabetes atlas. 10th ed. Brussels: International Diabetes Federation; 2021.

    Google Scholar 

  6. Lindstrom J, Peltonen M, Eriksson JG, Ilanne-Parikka P, Aunola S, Keinanen-Kiukaanniemi S, et al. Improved lifestyle and decreased diabetes risk over 13 years: long-term follow-up of the randomised Finnish Diabetes Prevention Study (DPS). Diabetologia. 2013;56(2):284–93.

    Article  CAS  Google Scholar 

  7. Li G, Zhang P, Wang J, Gregg EW, Yang W, Gong Q, et al. The long-term effect of lifestyle interventions to prevent diabetes in the China Da Qing Diabetes Prevention Study: a 20-year follow-up study. Lancet. 2008;371(9626):1783–9.

    Article  PubMed  Google Scholar 

  8. Knowler WC, Fowler SE, Hamman RF, Christophi CA, Hoffman HJ, Brenneman AT, et al. 10-year follow-up of diabetes incidence and weight loss in the Diabetes Prevention Program Outcomes Study. Lancet. 2009;374(9702):1677–86.

    Article  PubMed  Google Scholar 

  9. Pi-Sunyer X, Blackburn G, Brancati FL, Bray GA, Bright R, Clark JM, et al. Reduction in weight and cardiovascular disease risk factors in individuals with type 2 diabetes: one-year results of the look AHEAD trial. Diabetes Care. 2007;30(6):1374–83.

    Article  PubMed  Google Scholar 

  10. Wing RR. Long-term effects of a lifestyle intervention on weight and cardiovascular risk factors in individuals with type 2 diabetes mellitus: four-year results of the Look AHEAD trial. Arch Intern Med. 2010;170(17):1566–75.

    CAS  PubMed  Google Scholar 

  11. Redmon JB, Bertoni AG, Connelly S, Feeney PA, Glasser SP, Glick H, et al. Effect of the look AHEAD study intervention on medication use and related cost to treat cardiovascular disease risk factors in individuals with type 2 diabetes. Diabetes Care. 2010;33(6):1153–8.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  12. Rejeski WJ, Ip EH, Bertoni AG, Bray GA, Evans G, Gregg EW, et al. Lifestyle change and mobility in obese adults with type 2 diabetes. N Engl J Med. 2012;366(13):1209–17.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  13. Gong Q, Gregg EW, Wang J, An Y, Zhang P, Yang W, et al. Long-term effects of a randomised trial of a 6-year lifestyle intervention in impaired glucose tolerance on diabetes-related microvascular complications: the China Da Qing Diabetes Prevention Outcome Study. Diabetologia. 2011;54(2):300–7.

    Article  CAS  PubMed  Google Scholar 

  14. Knowler WC, Barrett-Connor E, Fowler SE, Hamman RF, Lachin JM, Walker EA, et al. Reduction in the incidence of type 2 diabetes with lifestyle intervention or metformin. N Engl J Med. 2002;346(6):393–403.

    Article  CAS  Google Scholar 

  15. Lindstrom J, Louheranta A, Mannelin M, Rastas M, Salminen V, Eriksson J, et al. The Finnish Diabetes Prevention Study (DPS): lifestyle intervention and 3-year results on diet and physical activity. Diabetes Care. 2003;26(12):3230–6.

    Article  PubMed  Google Scholar 

  16. Ratner R, Goldberg R, Haffner S, Marcovina S, Orchard T, Fowler S, et al. Impact of intensive lifestyle and metformin therapy on cardiovascular disease risk factors in the diabetes prevention program. Diabetes Care. 2005;28(4):888–94.

    Article  PubMed  Google Scholar 

  17. Weber MB, Ranjani H, Staimez LR, Anjana RM, Ali MK, Narayan KM, et al. The stepwise approach to diabetes prevention: results from the D-CLIP randomized controlled trial. Diabetes Care. 2016;39(10):1760–7.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  18. Galaviz KI, Weber MB, Suvada KB, Gujral UP, Wei J, Merchant R, et al. Interventions for reversing prediabetes: a systematic review and meta-analysis. Am J Prev Med. 2022;62(4):614–25.

    Article  PubMed Central  Google Scholar 

  19. Galaviz KI, Weber MB, Straus A, Haw JS, Narayan KMV, Ali MK. Global diabetes prevention interventions: a systematic review and network meta-analysis of the real-world impact on incidence, weight, and glucose. Diabetes Care. 2018;41(7):1526–34.

    Article  PubMed Central  Google Scholar 

  20. Haw JS, Galaviz KI, Straus AN, Kowalski AJ, Magee MJ, Weber MB, et al. Long-term sustainability of diabetes prevention approaches: a systematic review and meta-analysis of randomized clinical trials. JAMA Intern Med. 2017;177(12):1808–17.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Ali MK, Echouffo-Tcheugui J, Williamson DF. How effective were lifestyle interventions in real-world settings that were modeled on the diabetes prevention program? Health Aff (Millwood). 2012;31(1):67–75.

    Article  PubMed  Google Scholar 

  22. Conn VS, Hafdahl AR, Cooper PS, Brown LM, Lusk SL. Meta-analysis of workplace physical activity interventions. Am J Prev Med. 2009;37(4):330–9.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Mishra S, Barnard ND, Gonzales J, Xu J, Agarwal U, Levin S. Nutrient intake in the GEICO multicenter trial: the effects of a multicomponent worksite intervention. Eur J Clin Nutr. 2013;67(10):1066–71.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  24. Merrill RM, Aldana SG, Garrett J, Ross C. Effectiveness of a workplace wellness program for maintaining health and promoting healthy behaviors. J Occup Environ Med. 2011;53(7):782–7.

    Article  PubMed  Google Scholar 

  25. Aldana S, Barlow M, Smith R, Yanowitz F, Adams T, Loveday L, et al. A worksite diabetes prevention program: two-year impact on employee health. AAOHN J. 2006;54(9):389–95.

    Article  PubMed  Google Scholar 

  26. Morgan PJ, Collins CE, Plotnikoff RC, Cook AT, Berthon B, Mitchell S, et al. Efficacy of a workplace-based weight loss program for overweight male shift workers: the Workplace POWER (Preventing Obesity Without Eating like a Rabbit) randomized controlled trial. Prev Med. 2011;52(5):317–25.

    Article  PubMed  Google Scholar 

  27. Matson Koffman DM, Goetzel RZ, Anwuri VV, Shore KK, Orenstein D, LaPier T. Heart healthy and stroke free: successful business strategies to prevent cardiovascular disease. Am J Prev Med. 2005;29(5 Suppl 1):113–21.

    Article  PubMed  Google Scholar 

  28. Baumann AA, Cabassa LJ, Stirman SW. Adaptation in dissemination and implementation science. In: Brownson RC, Coditz GA, Proctor EK, editors. Dissemination and implementation research in health: translating science to practice. New York: Oxford Scholarship Online; 2017.

    Chapter  Google Scholar 

  29. Stirman SW, Gamarra J, Bartlett B, Calloway A, Gutner C. Empirical examinations of modifications and adaptations to evidence-based psychotherapies: methodologies, impact, and future directions. Clin Psychol (New York). 2017;24(4):396–420.

    PubMed  Google Scholar 

  30. WiltseyStirman S, Baumann AA, Miller CJ. The FRAME: an expanded framework for reporting adaptations and modifications to evidence-based interventions. Implement Sci. 2019;14(1):58.

    Article  Google Scholar 

  31. Coronado GD, Schneider JL, Green BB, Coury JK, Schwartz MR, Kulkarni-Sharma Y, et al. Health plan adaptations to a mailed outreach program for colorectal cancer screening among Medicaid and Medicare enrollees: the BeneFIT study. Implement Sci. 2020;15(1):77.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Holtrop JS, Gurfinkel D, Nederveld A, Phimphasone-Brady P, Hosokawa P, Rubinson C, et al. Methods for capturing and analyzing adaptations: implications for implementation research. Implement Sci. 2022;17(1):51.

    Article  PubMed Central  Google Scholar 

  33. Weber MB, Ranjani H, Meyers GC, Mohan V, Narayan KM. A model of translational research for diabetes prevention in low and middle-income countries: the Diabetes Community Lifestyle Improvement Program (D-CLIP) trial. Prim Care Diabetes. 2012;6(1):3–9.

    Article  PubMed  Google Scholar 

  34. Diabetes Prevention Program Research Group. The Diabetes Prevention Program (DPP): description of lifestyle intervention. Diabetes Care. 2002;25(12):2165–71.

    Article  Google Scholar 

  35. W. H. O. Expert Consultation. Appropriate body-mass index for Asian populations and its implications for policy and intervention strategies. Lancet. 2004;363(9403):157–63.

    Article  Google Scholar 

  36. Hennink M, Kaiser BN. Sample sizes for saturation in qualitative research: a systematic review of empirical tests. Soc Sci Med. 2022;292:114523.

    Article  PubMed  Google Scholar 

  37. Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Health. 2011;38(2):65–76.

    Article  PubMed  Google Scholar 

  38. Proctor EK, Landsverk J, Aarons G, Chambers D, Glisson C, Mittman B. Implementation research in mental health services: an emerging science with conceptual, methodological, and training challenges. Adm Policy Ment Health. 2009;36(1):24–34.

    Article  PubMed  Google Scholar 

  39. Grand Challenges Canada/Grand Defis Canada. Integrated innovation. 2010. September 2010.

  40. Sherwood NE, Jeffery RW. The behavioral determinants of exercise: implications for physical activity interventions. Annu Rev Nutr. 2000;20:21–44.

    Article  CAS  PubMed  Google Scholar 

  41. National Academies of Sciences Engineering and Medicine (U.S.). Committee on Fostering Healthy Mental Emotional and Behavioral Development Among Children and Youth. Effective implementation: core components, adaptation, and strategies. fostering healthy mental, emotional, and behavioral development in children and youth: a national agenda: a consensus study report of The National Academies of Sciences, Engineering, Medicine. Washington, DC: The National Academies Press; 2019. p. xvii, 370 pages.

  42. Weiner BJ, Lewis MA, Linnan LA. Using organization theory to understand the determinants of effective implementation of worksite health promotion programs. Health Educ Res. 2009;24(2):292–305.

    Article  Google Scholar 

  43. Bailey MM, Coller RK, Pollack Porter KM. A qualitative study of facilitators and barriers to implementing worksite policies that support physical activity. BMC Public Health. 2018;18(1):1145.

    Article  PubMed Central  Google Scholar 

  44. Mackenzie K, Such E, Norman P, Goyder E. Understanding the implementation of “sit less at work” interventions in three organisations: a mixed methods process evaluation. Int J Environ Res Public Health. 2021;18(14):7361.

    Article  PubMed  PubMed Central  Google Scholar 

  45. Witt LB, Olsen D, Ablah E. Motivating factors for small and midsized businesses to implement worksite health promotion. Health Promot Pract. 2013;14(6):876–84.

    Article  PubMed  Google Scholar 

  46. Weinstein M, Cheddie K. Adoption and implementation barriers for worksite health programs in the United States. Int J Environ Res Public Health. 2021;18(22):12030.

    Article  PubMed  PubMed Central  Google Scholar 

  47. Garne-Dalgaard A, Mann S, Bredahl TVG, Stochkendahl MJ. Implementation strategies, and barriers and facilitators for implementation of physical activity at work: a scoping review. Chiropr Man Ther. 2019;27:48.

    Article  Google Scholar 

  48. D’Cruz P, Rayner C. Bullying in the Indian workplace: a study of the ITES-BPO sector. Econ Ind Democr. 2012;34(4):597–619.

    Article  Google Scholar 

  49. Escoffery C, Lebow-Skelley E, Haardoerfer R, Boing E, Udelson H, Wood R, et al. A systematic review of adaptations of evidence-based public health interventions globally. Implement Sci. 2018;13(1):125.

    Article  PubMed  PubMed Central  Google Scholar 

  50. Chambers DA, Norton WE. The adaptome: advancing the science of intervention adaptation. Am J Prev Med. 2016;51(4 Suppl 2):S124–31.

    Article  PubMed  PubMed Central  Google Scholar 

  51. The World Bank. Labour force, total. 2023. Available from: https://data.worldbank.org/indicator/SL.TLF.TOTL.IN?most_recent_value_desc=true.

  52. Babu AS, Madan K, Veluswamy SK, Mehra R, Maiya AG. Worksite health and wellness programs in India. Prog Cardiovasc Dis. 2014;56(5):501–7.

    Article  Google Scholar 

  53. International Diabetes Federation. IDF diabetes atlas, 10th edition, India diabetes report 2000-2045. 2021. Available from: https://www.diabetesatlas.org/data/en/country/93/in.html.

  54. Luhar S, Timaeus IM, Jones R, Cunningham S, Patel SA, Kinra S, et al. Forecasting the prevalence of overweight and obesity in India to 2040. PLoS One. 2020;15(2):e0229438.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  55. Geldsetzer P, Manne-Goehler J, Theilmann M, Davies JI, Awasthi A, Vollmer S, et al. Diabetes and hypertension in India: a nationally representative study of 1.3 million adults. JAMA Intern Med. 2018;178(3):363–72.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

The study was supported by funding from the National Heart, Lung, and Blood Institute of the National Institutes of Health under grant R01HL125442. Additional support for ECR was provided by NIH grants D43TW009337 and R25TW009337. Additional support for PJ was provided by Wellcome Trust-DBT India Alliance intermediate (IA/CPHI/14/1/501497) and senior fellowships (IA/CPHS/20/1/505229).

Author information

Authors and Affiliations

Authors

Contributions

MBW was the lead analyst and author for the manuscript. ECR oversaw the qualitative data collection for the INDIA-WORKS study and provided guidance on the data analysis and reporting plan. MMH provided guidance on the development of the qualitative components of INDIA-WORKS. RH and PJ coordinated the study, oversaw all data collection, and provide contextually-specific feedback on results. MKA, RMA, VM, DP, and KMVN contributed to data interpretation. MBW and DP are the multi-Principle Investigators of the INDIA-WORKS trial. All authors contributed to the design of the study, provided feedback on results and interpretation of findings, read, and approved the final manuscript.

Authors’ information

MBW, ECR, RH, MMH, and PJ are PhDs and MKA, RMA, VM, DP, and KMVN are medical doctors. All authors are employed as academic researchers and MKA, RMA, and VM also do clinical care. All authors have expertise and experience in diabetes and cardiometabolic disease prevention and implementation of diabetes prevention programs in various settings. MBW, ECR, MMH, and RH are experienced qualitative researchers, and ECR and RH were part of the data collection team for the IDIs/FGDs.

MBW, ECR, RH, MMH, and RMA are female, and PJ, VM, MKA, DP, and KMVN are male. RH, PJ, RMA, VM, and DP are India-based members of the study team and ensured the team viewed the data with a culturally relevant and appropriate lens.

Corresponding author

Correspondence to Mary Beth Weber.

Ethics declarations

Ethics approval and consent to participate

INDIA-WORKS was approved the by Emory University Institutional Review Board (#IRB00080327), the Institutional Ethics Committees of the Public Health Foundation of India (#TRC-IEC-244/15), the Madras Diabetes Research Foundation, and Sree Chitra Tirunal Institute for Medical Sciences and Technology (IEC/1139). INDIA-WORKS was also approved by the Health Ministry Screening Committee (HMSC), Government of India (#50/4/IF-CVD/2015-NCD II). All participants provided written informed consent before screening for the INDIA-WORKS study and any study data collection including participation in and audio-taping of IDIs and FGDs.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Weber, M.B., Rhodes, E.C., Ranjani, H. et al. Adapting and scaling a proven diabetes prevention program across 11 worksites in India: the INDIA-WORKS trial. Implement Sci Commun 4, 134 (2023). https://doi.org/10.1186/s43058-023-00516-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s43058-023-00516-1

Keywords