Table 1 Data extraction

Funding ICO^a

NIH Institute, Center, or Institute [ICO] funding the grant

Study Section^a

Scientific review group that scored the grant application

RFA PAR #^a

Notice of funding to which the grant was submitted

Funding Mechanism^a

Type of grant

Fiscal Year^a

Fiscal year in which the grant was funded

Intervention

Is an intervention being disseminated, implemented or de-implemented in this study? Take implementation to also mean de-implementation throughout coding. Take intervention to mean evidence-based program, practice, policy. (yes or no)

Intervention Level

Social ecological level at which the study intervention takes place [40, 41]

Intervention Setting

Setting in which the intervention is delivered

Intervention Implementer(s)

Roles implementing the intervention

Condition Under Study

Conditions are diseases, disorders, syndromes, illnesses, or injuries that are automatically extracted from grant text using natural language processing software that identifies phrases and synonyms along with their associated MeSH semantic type.

Health Disparities-Relevant Research

Are minority health, health disparities, or health equity being studied? (yes or no)

• Minority health research is the scientific investigation of distinctive health characteristics and attributes of minority racial and/or ethnic groups who are usually underrepresented in biomedical research to understand health outcomes in these populations [55].

• A health disparity is a health difference that adversely affects disadvantaged populations, based on higher disease burden, risk factors, condition-specific symptoms, and/or other categories of health outcomes. Health disparities research is directed to understanding the mechanism as to why a defined disadvantaged group has a worse health outcome compared to a reference group and how this knowledge is translated into interventions to reduce health disparities [55].

• Health equity means all populations will have an equal opportunity to live long, healthy, and productive lives. Health equity research is directed to upstream, fundamental causes of health disparities at outer social ecological levels (community, environment, policy), including interventions to address social or structural determinants of health.

Disparities Population

Population with health disparities that is the focus of the research. For NIH, populations that experience health disparities include [55]:

• Racial and ethnic minority groups (see OMB Directive 15)

• People with lower socioeconomic status (SES)

• Underserved rural communities

• Sexual and gender minority (SGM) groups

Engagement Timing

Where is engagement happening throughout the study?

Engagement Audience

Types of research participants and partners engaged, using the The 7Ps Framework from Concannon et al. (2012) and definitions adapted from PCORI (2018) [51, 52]

• Direct service providers or practitioners—professionals who would deliver the intervention/service and/or the organizations they work within

• Patients / survivors or their families—people who would receive the intervention/service, e.g., persons with current or past experience of illness or injury, family members or other unpaid caregivers of patients

• Policymakers—those who help craft public policy at any level of government, including federal, state, and local government officials; federal, state, and local units of government; and organizations that represent policymakers

• Product makers / intervention designers—people or companies who design, invest in, or manufacture the original innovation/intervention being implemented, e.g., drug, diagnostic technology, device, electronic records or other software or app developers or manufacturers and organizations representing the life sciences industry

• Program/system administrators—people or organizations who would approve the adoption of the intervention or service

• Public / General community members—people who have not received a disease diagnosis who would potentially receive the intervention/service, e.g., school children or their parents, people with lived experience in determinants of health outcomes, consumer advocacy organizations

• Purchasers or Payers—people or organizations who would pay for the intervention or service through underwriting or reimbursement, serving as financial intermediaries, or purchasing health benefits for employees and their dependents, e.g., could include a foundation sponsor/funding agency; individual businesses as well as local, state, regional, and national business groups, coalitions that represent businesses, and health coalitions; private insurers and public insurers, and organizations representing insurers

• Partner organizations—organizations that can provide access to any of the above groups, e.g., coalitions/networks, professional associations, advocacy groups, etc.

Engagement Level

Highest level of engagement demonstrated in proposal according to definitions from Sanders Thompson et al. [53]:

• Outreach and education—Research team members develop, implement, and evaluate strategies to reach the population of interest. Organizational partners can be engaged as advisors and can make key connections. In some instances, researchers are trying to educate community residents and/or patients about a particular topic. In these cases, outreach efforts are used to gain audiences for education sessions and/or materials.

• Consultation—Researchers ask community residents and/or patients for advice on important elements of a project or activity. The provided feedback informs the research, but the researchers are responsible for designing and implementing projects with no help expected from the people who were consulted.

• Cooperation—Researchers ask community residents and/or patients for advice and help with a project. Such help may include activity in defined aspects of the project, including recruitment, activities related to doing the intervention, the creation of study questions and measures, and the interpretation of outcomes. Researchers and community residents and/or patients work together to make decisions throughout the project.

• Collaboration—Patients, caregivers, clinicians, researchers, and/or community members partner in every aspect of the research, including setting priorities, study design, implementation, analysis/interpretation, and dissemination. Collaborations are built on mutual respect and trust. All partners are valued, benefit from the research, and share decision-making, power, and resources.

• Partnership—A strong, bidirectional relationship exists among patients, caregivers, clinicians, researchers, and community members (or a combination of these categories) regarding every aspect of the research, including setting priorities, study design, implementation, analysis/interpretation, and dissemination. The relationship is built on trust and mutual respect. All partners are valued, benefit from the research, and share decision-making, power, and resources. Strong partnership processes exist for how resources are shared, how decisions are made, and how ownership of the work is determined and maintained. Partnerships are the result of long-term relationships and have moved beyond working on a single project. Partners have a history of collaboration, having worked together previously.

Engagement Approach

Engagement approach described

Engagement Strategies

Engagement methods/ strategies/ activities described

Engagement Equity

Indicators of equity in engagement based on Key et al. [54], definitions original:

• Decision-making—Proposal describes shared decision-making authority and/or processes to facilitate equitable, engaged consensus building for decision-making and conflict resolution

• Influence—Proposal describes processes or mechanisms for how practitioner(s) can inform the research at any stage (e.g., from question and hypothesis generation to study design and implementation to data analysis and knowledge creation to dissemination and translation of results)

• Mutual benefit—Proposal describes how the engagement and/or study outcomes will be of value to both the researcher(s) and community partner(s)

• Ownership—Proposal addresses who has ultimate ownership over the research, data collected and/or the distribution of findings

• Power and control—Proposal recognizes power differentials between academic and community partners and describes actions to mitigate, including but not limited to detailing specific leadership roles for partner(s)

• Resource-sharing—Evidence of financial resource allocation (e.g., subaward(s)) with community partner organization(s) in budget commensurate with role in the project (e.g., community co-investigator or multi-PI)

• Responsibility—Proposal describes specific responsibilities of research team to the community partner(s) (e.g., capacity building)

D&I Study Type

Is this a dissemination, implementation, both D&I, or de-implementation study?

• Dissemination research is the scientific study of targeted distribution of information and intervention materials to a specific public health or clinical practice audience. The intent is to understand how best to spread and sustain knowledge and the associated evidence-based intervention(s) [1,2,3].

• Implementation research is the scientific study of the use of strategies to adopt and integrate evidence-based health interventions into clinical and community settings in order to improve patient outcomes and benefit population health [1,2,3].

• De-implementation is “reducing or ceasing the delivery of ineffective, unproven, harmful, or low-value practices, treatments, programs, interventions, and guidelines” [56]

Implementation Phase

Phase(s) of implementation the research questions address

Study Design

Study design employed

Hybrid Study Type

From Curran et al. [44]

D&I Theory

Model, theory or framework used

Implementation Strategies

Implementation strategies employed, as defined in Waltz et al. and Powell et al. [45, 46]