Skip to main content
Download PDF
Download ePub

The development and evaluation of an HIV implementation science network in New England: lessons learned

Implementation Science Communications volume 2, Article number: 64 (2021) Cite this article

Abstract

Background

Describe and evaluate an implementation science network focused on HIV prevention and treatment in New England.

Methods

In 2014, we established a partnership among university researchers and community stakeholders to stimulate and support HIV-related implementation research. We solicited information from Network members through surveys, interviews at Network events, and dialog with participants. In 2017, we conducted a sociocentric network assessment of collaborations on research projects, grants, manuscripts, and consultations.

Results

We identified 988 connections made through the Network that resulted in 185 manuscripts published and 15 grants funded. Our experience indicated that eight factors were instrumental in building and sustaining the Network: (1) acknowledging different perspectives, (2) balancing content and expertise, (3) encouraging consistent engagement, (4) providing seed funding, (5) membership flexibility, (6) maintenance of Network interactions, (7) supporting local HIV prevention and treatment efforts, and (8) maintaining productive relationships with health departments and community-based organizations.

Conclusions

Developing and maintaining a regional network on implementation science for HIV prevention and treatment is feasible and can facilitate new and productive partnerships among researchers and community organizations and members.

Peer Review reports

Background

Promoting the implementation of prevention and treatment interventions that have been shown to be effective is urgently needed [1]. Implementation science has been defined as “the study of methods to promote the adoption and integration of evidence-based practices, interventions, and policies into routine health care and public health setting.” [2]. Implementation science plays an important role in identifying barriers and facilitators of effective health programming and policymaking [2].

In the fields of HIV prevention and treatment, there is growing interest in implementation science [3]. It fills gaps between the perspectives of researchers, clinicians, and public health practitioners by evaluating the use of evidence-based interventions in clinical and community settings [4]. HIV implementation science is a multidisciplinary specialty that seeks generalizable knowledge about the behavior of stakeholders, organizations, and communities to close the gap between evidence and routine practice for health in real-world contexts [5].

The persistent HIV epidemic in small urban cities has heightened interest in implementing effective interventions as these areas face unique challenges to implementation, including smaller social networks, increased stigma, fewer specialized resources, and migration in and out of rural and large urban centers [6, 7]. HIV prevention and care interventions that are designed for larger urban centers but then applied to small urban areas, may not translate well.

The Yale Center for Interdisciplinary Research on AIDS (CIRA) and the Providence/Boston Center for AIDS Research (P/B CFAR) collaborated in 2014 to develop a New England HIV Implementation Science Network (hereafter referred to as the Network) to share regional knowledge to improve HIV prevention and treatment efforts in small urban areas defined as cities with a population less than 200,000. The goals of the Network were to (1) foster partnerships among agencies, stakeholders, and researchers and (2) stimulate and support research and evaluation collaborations across New England, with a focus on implementation science in small urban areas with a high prevalence of HIV. In this report, we describe the establishment of the Network, the lessons learned, and its impact.

Methods

Network symposia

To form the Network, Yale CIRA and P/B CFAR identified and invited stakeholders, including all regional health departments, AIDS service organizations, HIV providers and clinics, Federally Qualified Health Centers (FQHCs), academic institutions, patient advocacy groups, industry representatives, and non-governmental research organizations to become Network members. To date, the Network has conducted a total of six annual symposia, four supplemental workshops, and multiple leadership planning meetings (Table 1). Attendance at these gatherings generally included members from community-based organizations (CBOs) (29%), research institutions (29%), community health centers (17%), regional health departments (11%), other (8%), advocates (4%), and industry (2%). After each event, CIRA and the P/B CFAR facilitated follow-up meetings to support research collaborations for grant applications on HIV implementation science.

Table 1 List of symposia and selected workshops from the New England HIV Implementation Science Network, 2014–2019
Full size table

Network goals

Our approach to achieving Network goals included (1) developing an understanding of implementation science research concepts; (2) forming academic-community partnerships around topics of mutual interests; (3) obtaining input from community partners on local needs/priorities; (4) generating research questions that could be addressed through implementation science research; (5) offering support to academic-community partnerships interested in pursuing research funding by linking them to implementation science experts, providing logistical meeting support, and providing seed funding; and (6) encouraging Network members to report their experiences and successes to inform future Network partnerships. Figure 1 presents a logic model of the relationships between the network purpose, goals, inputs, outputs, and impact.

Fig. 1
figure 1

New England HIV Implementation Science Network Development: planning, implementation, and evaluation

Full size image

Capacity building efforts

The Network has provided training on implementation science and supported the development of collaborative projects by creating an online Network Resource Center, establishing a joint pilot project award supported by the two centers, disseminating grant opportunities and facilitating discussions to incentivize collaborations, promoting implementation science capacity through webinars, the aforementioned workshops, facilitating matchmaking of researchers and with community/practice partners, and convening meetings to coordinate and refine research project concepts.

Assessment

Quantitative and qualitative feedback was routinely solicited from members about the organization, logistics, and quality of Network activities through electronic surveys, verbal feedback at Network events, informal interviews, and periodic dialog with representatives from the research and practice spheres.

At the fourth Network symposium in 2017, we undertook a more systematic evaluation of its impact on building collaborations and projects by conducting a sociocentric network assessment [8]. We asked 84 of the most active members of the Network to anonymously describe their ties/connections with other Network members on (a) research projects, (b) grants submitted and received, (c) manuscripts, and (d) consultations. Individual responses were aggregated within organization and analyzed interactions by organization and organization type (e.g., research, health department, community-based organization) [9, 10]. Social network analysis was used to assess Network characteristics, including density (ratio of the number of observed ties divided by the total number of possible ties) [10]. Seventy-five individuals from 34 organizations completed the social network assessment. Lessons learned were generated from open ended feedback and process notes taken by staff that were discussed by the leadership group until consensus of the main lessons learned were reached.

Results

In almost all Network meetings, researchers comprised less than half of the attendees. After the initial “kick-off” meeting, participants identified their primary areas of interest and four workgroups were formed around different topics (e.g., hard-to-reach/high-risk populations, technology and social media, modeling and cost utility analysis, and mapping) to develop research ideas. A major goal of the second symposium was to move from “Concepts to Projects.” A third symposium focused on advancing emerging ideas. Subsequent workshops focused on implementation science methods, mathematical modeling, and developing community research capacity. The fourth symposium focused on “Putting Implementation Science into Practice,” while the most recent symposia focused on addressing topics of interest to community participants and providing a mix of capacity building activities to better meet the needs of participants with varying levels of implementation science expertise. The symposia had multiple functions in addition to capacity building and the Network did not provide a structured curriculum on implementation science. Nevertheless, all meetings addressed issues in implementation science to some extent. The issues and topics covered are summarized in Table 1. One of the goals of the Network was to provide resources to support the development and execution of implementation science initiatives. To that end, CIRA developed a website where Network information is compiled (https://cira.yale.edu/network); it includes a wide range of resources related to implementation science.

The sociocentric network assessment documented 988 connections between organizations that resulted in 185 manuscripts published and 15 grants funded. Most connections with research institutions in the Network were with non-academic, implementing organizations. After eliminating multiple connections, there were 579 unique connections from network members at research institutions. Of those, 308 were to implementing organizations, such as health departments, FQHCs, CBOs, and to a lesser extent industry.

There were 285 connections generated by Network activities related to research ideas; 200 connections resulted in grant submissions, and 162 connections represented grant-funded activities. Eighty ties represented co-authorships on a manuscript. Using a standard measure of network density [8], the ratio of observed pairings to all possible pairings (8128) yielded a value of .15, suggesting a very high density.

Network activities led to 16 collaborative research projects as listed in Table 2. Some projects were supported by CIRA and/or P/B CFAR pilot funds, others were submitted as National Institutes of Health (NIH) R01 applications with two of those successfully funded, and several with more immediate practical application were funded by state health departments.

Table 2 Collaborative research projects across the New England HIV Implementation Science Network, 2014–2019
Full size table

The authors reviewed information from routine surveys of Symposium participants, interviews at Network events, and periodic dialog with participants and distilled the following lessons about factors affecting the success of Network activities.

Lessons learned

Lesson 1: Acknowledging different perspectives

In clinical trials, there is an emphasis on random assignment of participants to ensure generalizability and reduce bias. They also tend to have strict eligibility criteria. However, community practitioners are often interested in specific sub-populations and/or factors that impact program implementation in specific settings. Moreover, in implementation science, there often is interest in how inner and outer contextual factors impact the implementation or effectiveness of an initiative, an approach that many traditional researchers are not familiar with. These different perspectives must be acknowledged and effectively managed.

Workgroup meetings benefit from the inclusion of strong facilitators who understand how to focus on researchable questions while respecting the perspectives of individuals and agencies that may have different priorities and timeframes. As one participant reported, “My organization does not have the infrastructure or capacity to execute a study, but the subjects we discussed impact the work we do on a very basic, real level, so it would be great to figure out a way to be involved in a study on the subject” (Health Care/Social Service Provider, 2018 Symposium).

Lesson 2: Balancing introductory and in-depth material

Surveys of network participants suggest that it was a challenge to provide an optimal balance of introductory and in-depth material. Researchers appreciated the focus on implementation science methods: “Loved the detailed descriptions of the conceptual frameworks and how they were used!” (Researcher, 2017 Symposium) and “Great examples of D+I [Dissemination and Implementation] frameworks and practical application” (Researcher, 2017 Symposium). However, some participants reported didactic content “too scientific and detailed” (Public Health staff, 2015 workshop), “dry and drawn out” (Advocate, 2015 workshop), or “more academic focused than what I deal with on a day-to-day basis” (Health care/Social service provider, 2015 workshop). Educational programs need to address the different levels of experience with implementation science and how it may be defined and utilized differently. Multi-tiered trainings that start out with broad foundational concepts on implementation science and then get more specific depending on the interest and needs of the target audience members may be one way to balance the level of content and expertise presented.

A roughly equal balance of academic researchers and community participants ensured that both were represented in smaller breakout groups, where the goal was typically to meet others with a common interest and to develop potential research questions. These sessions provided for a “Great exchange of ideas” (Advocate, 2015 Symposium) and forged connections, helping attendees to “network with regional colleagues” (Public Health Staff, 2015 Symposium) and “identify other individuals interested in the same questions that I would like answered” (Physician, 2016 Symposium).

Lesson 3: Encouraging consistent engagement

Ongoing and frequent engagement with a large, diverse membership is needed to maintain long-term interest in and connection to the Network. Long-term interest in and connection to the Network in turn facilitate capacity building in implementation science. Long-term engagement can also facilitate the development of implementation science research projects. Inclusion of all New England states has been desirable to identify and address similar issues across the region as well as to leverage resources, but involvement in in-person events by the more geographically remote of the six states (e.g., Maine, New Hampshire, Vermont) has proven difficult. Attempts to conduct workgroup meetings by video conference were very challenging because of inconsistent connections and audio quality. Eventually, that approach was dropped, except for very focused, engaged groups. Those meetings were conducted before the widespread use of videoconferencing during the COVID-19 pandemic so this may be much less of a concern for future activities. Large, inclusive meetings are important to establish connections and promote openness, but to achieve results it is necessary to select more engaged members for more focused discussions.

Lesson 4: Providing seed funding

Providing seed funding to launch research collaborations for larger studies is essential to move Network member ideas to action and to create mini “learning collaboratives” to cultivate practice-academic research relationships. Time is a key constraint reported by both academic and community participants, and small grants have supported some of the researcher effort required to pursue projects developed during Network events or within Network collaboratives. For example, a “Syphilis to Pre-Exposure Prophylaxis (PrEP)” health navigation project for men who have sex with men (MSM) with syphilis diagnoses was developed during the 2015 Network Symposium with funding from the Connecticut (CT) Department of Public Health. This project was motivated by the rise in number of syphilis cases in the state reported by the local health department and interest in addressing this public health concern among medical practitioners and researchers. These shared interests were discussed at the Network meeting. The experience and connections made among CIRA researchers, health department staff, and local providers stimulated further PrEP linkage efforts in the state and laid the foundation for a successful application for a Centers for Disease Control and Prevention demonstration project funding to CT Department of Public Health in 2018 to promote PrEP adoption among Black/African American and Hispanic/Latino MSM.

Lesson 5: Permitting membership fluidity

Network member assessment, surveillance, recruitment, engagement, and re-engagement are an ongoing process that requires careful attention. Membership is fluid and participation can be erratic; people step in and out of the process depending on level of interest, role in the Network, and what is on the agenda that is of interest to different stakeholders. As new people are hired for practice and HIV research positions, and/or different organizations enter the scene due to HIV grant program/funding volatility and other developments, they need to be identified, informed about the Network, and engaged if interested. The experience of existing members also requires evaluation to assess interests/needs for additional support from Network coordinators. It also is important to assess and develop the implementation science skills of members to support advancement of large, funded implementation science research projects.

Lesson 6: Maintenance of network interactions

Network maintenance and facilitation require dedicated, appropriately skilled professionals with strong connections to both the practice and research spheres. Building trusting, reciprocal relationships between HIV practice and research sectors also requires having a Network dedicated staff member, and others from Network lead organizations actively involved in the practice sphere, such as attending HIV statewide and community-based meetings in the region, serving on committees, contributing to initiatives such as statewide “Getting to Zero” or “90-90-90” campaigns [11, 12].

Lesson 7: Supporting local HIV prevention and treatment efforts

Evaluation of existing local HIV programs is often of interest to HIV clinicians and finding ways to support these needs can bridge the practice-research gap and earn more buy-in from practice partners. These projects are an opportunity to build relationships and community research capacity and can even generate data for use in more research-oriented applications [13, 14]. From the perspective of CBOs, better program data are useful for quality improvement as well as future grant applications. Multiple approaches to engaging and sustaining participation are important, including moving location of meetings, offering large and smaller structured programs, and experimenting with virtual meeting platforms.

Lesson 8: Developing sustained and productive relationships

Developing sustained and productive relationships with state health departments is essential. For example, the 2017 Network symposium included a panel of HIV program directors from the six New England state health departments who presented HIV continuum of care data for their areas and identified research questions of regional interest. This led to a three-state Network study designed to examine issues around the approach to and uptake of partner referral services among MSM living with HIV.

Cultivating and sustaining partnerships with CBOs is equally important as they are the front line of the HIV service delivery system where implementation of most HIV interventions occurs. These providers face challenges in selecting and adapting interventions to optimize prevention and treatment outcomes, challenges that can be addressed through implementation science.

Discussion

In this report, we describe the development and functioning of a new regional model for integrating community and academic efforts in implementation science to address HIV prevention and treatment. The Network has stimulated and supported new collaborative research addressing issues of HIV prevention and treatment in small urban areas and enhanced the research capacity of affiliated scientists and community partners to conduct implementation science.

Our experience demonstrates that a multidisciplinary and multi-sector research network can foster productive and lasting collaborations between researchers and practitioners with tangible outcomes. To optimize these gains will require sustained and strategic support and facilitation of the process, ongoing information sharing, and regional networking. In the future, we plan to disseminate the lessons learned while expanding the Network and to share successful methods for maintaining collaborative partnerships. We hope to expand engagement to interested parties from other regions of the country through the Department of Health and Human Services’ Ending the HIV Epidemic initiatives. Going forward, dissemination approaches will include publications, conference presentations, and the online Network Resource Center. The Network will support the development and evaluation of initiatives that advance the federal government’s National HIV/AIDS Strategy by supporting the development of interventions tailored to small urban centers and other understudied communities.

Now that the Network is running effectively, we will focus more on developing federally funded implementation science projects that build on the unique relationships and collaborations fostered by the Network. Addressing the unevenness in capacity and readiness to engage in implementation science among Network members will be critical to our ability to foster successful grant applications and projects. Implementation science capacity is now much stronger at Network academic institutions due to several new training and grant activities. Thus, in the next phase, we will be able to connect Network members to a broader range of training programs for academic researchers and community practice partners in implementation science methods and community-engaged research. As these programs are refined, we will offer them broadly using digital learning technology.

To reach a broader audience, we will also expand our online Network Resource Center, providing wide access to materials for those interested in conducting research in small urban centers. The Resource Center (https://cira.yale.edu/network) provides (1) links to training on implementation science; (2) information on current implementation, dissemination, and translation research, using social media/technology; (3) bibliographies; and (4) approaches to address challenges in doing research in small urban areas.

Conclusions

Implementation science has a potentially important role in advancing the goals of the National HIV/AIDS Strategy and the new federal plan to end AIDS by 2030. There is a long history of collaboration among researchers in multiple disciplines [15] and there are often formal organizational structures for such collaborations [16], but implementation research is embedded in community and care sites. To be successful requires the engagement and collaboration of community partners who work in these settings. There are many types of research networks [17], but a network form that has attracted increasing attention is the research consortia, the purpose of which is to conduct research that meets the needs of users and enables them to act [16]. Our experience with the New England HIV Implementation Science Network suggests that such networks can provide a useful platform to support research examining the implementation of interventions and programs addressing HIV prevention and treatment in small urban areas with a high burden of disease that are often understudied.

Availability of data and materials

The data used and/or analyzed during the current study are available from the corresponding author on reasonable request.

Abbreviations

CIRA:

Center for Interdisciplinary Research on AIDS

CBO:

Community-based organization

CT:

Connecticut

D+I:

Dissemination and Implementation

FQHC:

Federally qualified Health Center

HIV:

Human immunodeficiency virus

MSM:

Men who have sex with men

Network:

New England HIV Implementation Science Network

NIH:

National Institutes of Health

P/B CFAR:

Providence/Boston Center for AIDS Research

PrEP:

Pre-exposure prophylaxis

References

  1. Theobald S, Brandes N, Gyapong M, El-Saharty S, Proctor E, Diaz T, et al. Implementation research: new imperatives and opportunities in global health. Lancet. 2018;392(10160):2214–28. https://doi.org/10.1016/S0140-6736(18)32205-0.

    Article  PubMed  Google Scholar 

  2. Fogarty International Center. Implementation science information and resources. (2019).. https://www.fic.nih.gov/ResearchTopics/Pages/ImplementationScience.aspx. Accessed 9 Jan 2021.

    Google Scholar 

  3. Shangani S, Bhaskar N, Richmond N, Operario D, van den Berg JJ. A systematic review of early adoption of implementation science for HIV prevention or treatment in the United States. AIDS. 2021;35(2):177–91. https://doi.org/10.1097/QAD.0000000000002713.

    Article  PubMed  Google Scholar 

  4. Smith JD, Li DH, Hirschhorn LR, Gallo C, McNulty M, Phillips G 2nd, et al. Landscape of HIV implementation research funded by the National Institutes of Health: a mapping review of project abstracts. AIDS Behav. 2020;24(6):1903–11. https://doi.org/10.1007/s10461-019-02764-6.

    Article  PubMed  Google Scholar 

  5. Odeny TA, Padian N, Doherty MC, Baral S, Beyrer C, Ford N, et al. Definitions of implementation science in HIV/AIDS. Lancet HIV. 2015;2(5):e178–80. https://doi.org/10.1016/S2352-3018(15)00061-2.

    Article  PubMed  Google Scholar 

  6. Kalichman S, Katner H, Banas E, Kalichman M. Population density and AIDS-related stigma in large-urban, small-urban, and rural communities of the southeastern USA. Prev Sci. 2017;18:517–25. https://doi.org/10.1007/s11121-017-0761-9.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Keene DE, Eldahan AI, White Hughto JM, Pachankis JE. ‘The big ole gay express’: sexual minority stigma, mobility, and health in the small city. Cult Health Sex. 2017;19(3):381–94. https://doi.org/10.1080/13691058.2016.1226386.

    Article  PubMed  Google Scholar 

  8. de Laat M, Lally V, Lipponen L, Simons PRJ. Investigating patterns of interaction in networked learning and computer-supported collaborative learning: a role for social network analysis. Int J Comput Support Collab Learn. 2007;2(1):87–103. https://doi.org/10.1007/s11412-007-9006-4.

    Article  Google Scholar 

  9. Tichy NM, Tushman ML, Fombrun C. Social network analysis for organizations. Acad Manage Rev. 1979;4(4):507–19. https://doi.org/10.2307/257851.

    Article  Google Scholar 

  10. Knoke D, Yang S. Social network analysis. 3rd ed. Thousand Oaks: Sage Publications; 2020.

  11. Getting to Zero CT. 2018. https://gettingtozeroct.org/. Accessed 9 Jan 2021.

  12. HIV 90-90-90 Initiative. 2018. https://health.ri.gov/programs/detail.php?pgm_id=1079. Accessed 9 Jan 2021.

  13. Humphries D, Ma M, Collins N, Ray N, Wat E, Bazelon J, et al. Assessing research activity and capacity of community-based organizations: refinement of the CREAT instrument using the Delphi method. J Urban Health. 2019;96(6):912–22. https://doi.org/10.1007/s11524-019-00374-0.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Humphries DL, Carroll-Scott A, Mitchell L, Tian T, Choudhury S, Fiellin DA. Assessing research activity and capacity of community-based organizations: development and pilot testing of an instrument. Prog Commun Health Partnership. 2014;8(4):421–32. https://doi.org/10.1353/cpr.2014.0067.

    Article  Google Scholar 

  15. Cummings JN, Kielser S. Collaborative research across disciplinary and organizational boundaries. Soc Stud Sci. 2005;35(5):703–22. https://doi.org/10.1177/0306312705055535.

    Article  Google Scholar 

  16. Dimitrova D, Koku E. Managing collaborative research networks: the dual life of a virtual community of practice. Int J Virtual Commun Soci Netw. 2010;2(4):1–22. https://doi.org/10.4018/jvcsn.2010100101.

    Article  Google Scholar 

  17. Bos N, Zimmerman A, Olson J, Yew J, Yerkie J, Dahl E, et al. From shared databases to communities of practice: a taxonomy of collaboratives. J Comput Mediat Commun. 2008;12(2):318–38. https://doi.org/10.1111/j.1083-6101.2007.00343.x.

    Article  Google Scholar 

Download references

Acknowledgements

We gratefully acknowledge the effort, commitment, and dedication of all our regional partners who are part of the New England HIV Implementation Science Network, and thank Jim Pettinelli, former Assistant Director for CIRA’s Community Implementation Research Core, for his seminal role in forming the Network.

Funding

This work was supported by the National Institute of Mental Health through the Yale University Center for Interdisciplinary Research on AIDS [P30MH0162294; PI: Cleary] and the National Institute of Allergy and Infectious Diseases through the Providence/Boston Center for AIDS Research [P30AI042853; PI: Cu-Uvin]. The funders did not require that they approve the publication and did not review the manuscript prior to submission.

Author information

Authors and Affiliations

  1. Department of Behavioral and Social Sciences, Center for Alcohol and Addiction Studies, School of Public Health, Brown University, Providence, RI, USA

    Jacob J. van den Berg

  2. Department of Epidemiology, Harvard T.H. Chan School of Public Health, Boston, MA, USA

    Jacob J. van den Berg

  3. Center for Interdisciplinary Research on AIDS, Yale School of Public Health, PO Box 208034, New Haven, CT, 06520-8034, USA

    Elaine O’Keefe, Daniel Davidson, David A. Fiellin, Trace Kershaw, Russell C. Barbour & Paul D. Cleary

  4. Department of Medicine, Yale School of Medicine, 333 Cedar Street, New Haven, CT, 06520, USA

    David A. Fiellin

  5. Department of Social and Behavioral Sciences, Yale School of Public Health, 60 College Street, New Haven, CT, 06520-8034, USA

    Trace Kershaw

  6. Department of Ob-Gyn and Medicine, Alpert School of Medicine, Brown University, Providence, USA

    Susan Cu-Uvin

  7. Division of Infectious Diseases, The Miriam Hospital, Providence, RI, USA

    Susan Cu-Uvin

  8. Department of Health Policy and Management, Yale School of Public Health, 60 College Street, New Haven, CT, 06520-8034, USA

    Paul D. Cleary

Authors
  1. Jacob J. van den Berg
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Elaine O’Keefe
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Daniel Davidson
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. David A. Fiellin
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Trace Kershaw
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Russell C. Barbour
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Susan Cu-Uvin
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Paul D. Cleary
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

JJvdB, EO, DF, TK, DD, RB, SC, and PC contributed to the conception of this manuscript. JJvdB, TK, and DD contributed to the collection of information about network activities. JJvdB, EO, DF, TK, DD, RB, and PC contributed to the drafting of the manuscript and JJvdB, EO, DF, TK, DD, RB, SC, and PC contributed to manuscript revisions. All authors approved the submitted version and have agreed both to be personally accountable for their contributions and the accuracy or integrity of the manuscript.

Corresponding author

Correspondence to Paul D. Cleary.

Ethics declarations

Ethics approval and consent to participate

Not applicable. Approval was not necessary because no identifiable information was collected for research purposes. Any information obtained was done so anonymously and all participants were told that participation was voluntary.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

van den Berg, J.J., O’Keefe, E., Davidson, D. et al. The development and evaluation of an HIV implementation science network in New England: lessons learned. Implement Sci Commun 2, 64 (2021). https://doi.org/10.1186/s43058-021-00165-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s43058-021-00165-2

Keywords

Implementation Science Communications

ISSN: 2662-2211