Skip to main content

Strengthening research capacity through an intensive training program for biomedical investigators from low- and middle-income countries: the Vanderbilt Institute for Research Development and Ethics (VIRDE)

Abstract

Background

Capacity strengthening initiatives aimed at increasing research knowledge and skills of investigators in low- and middle-income countries (LMICs) have been implemented over the last several decades. With increased capacity, local investigators will have greater leadership in defining research priorities and impact policy change to help improve health outcomes. Evaluations of models of capacity strengthening programs are often limited to short-term impact. Noting the limitations of traditional output-based evaluations, we utilized a broader framework to evaluate the long-term impact of the Vanderbilt Institute in Research Development and Ethics (VIRDE), a decade-old intensive grant development practicum specifically tailored for investigators from LMICs.

Methods

To assess the impact of VIRDE on the research careers of alumni over the past 10 years, we surveyed alumni on research engagement, grant productivity, career trajectory, and knowledge gained in grant writing. Descriptive statistics, including means and total counts, and paired sample t-tests were used to analyze the data.

Results

Forty-six of 58 alumni completed the survey. All respondents returned to their home countries and are currently engaged in research. Post-VIRDE grant writing knowledge ratings were significantly greater than pre-VIRDE. The number of respondents submitting grants post-VIRDE was 2.6 times higher than before the program. Eighty-three percent of respondents submitted a total of 147 grants post-VIRDE, of which 45.6% were awarded. Respondents acknowledged VIRDE’s positive impact on career growth and leadership, with 88% advancing in career stage.

Conclusions

Gains in grant writing knowledge and grant productivity suggest that VIRDE scholars built skills and confidence in grant writing during the program. A substantial proportion of respondents have advanced in their careers and continue to work in academia in their country of origin. Results show a sustained impact on the research careers of VIRDE alumni. The broader framework for research capacity strengthening resulted in an expansive assessment of the VIRDE program and alumni, illuminating successful program elements and implications that can inform similar capacity strengthening programs.

Peer Review reports

Background

Despite commitment by national governments and international funding, health outcomes in many low- and middle-income countries (LMICs) lag behind other nations [1]. Improving health outcomes may be linked to improved local academic biomedical research in these countries [2,3,4,5,6,7]. Effective, transformative research leaders can contribute to advances in responding to infectious and non-communicable diseases in their communities [8]. Over the past several decades, there has been increased emphasis on strengthening research knowledge and skills of investigators in LMICs [9]. With increased research skills and knowledge, local investigators could have greater leadership in defining priority research topics, as well as participating in data analysis and dissemination of results. Such leadership and influence would place investigators in prime positions to impact policy change to help improve health outcomes.

Many models of research capacity strengthening have been implemented over the years [10]. Programs have ranged from short-term, in-country workshops to multi-year, out-of-country degree programs and have focused on either a single topic area or multiple areas. Instruction is often conducted in-person, while some programs have utilized distance learning options [11, 12]. Beyond didactic lectures on research methodologies, common program elements include mentorship and participating in field placements or team-based projects [11, 13,14,15,16,17,18,19,20]. Programs are frequently implemented through multi-country partnerships, whether between high-income countries (HICs) and LMICs or a regional consortia of LMICs [7, 21,22,23,24,25,26,27,28,29]. Most programs report successful short-term impacts on increased knowledge among program participants, but some authors have criticized these capacity strengthening activities for not having a greater long-term impact on health outcomes [3, 9, 30]. Additional critiques of these programs include a lack of standard definitions, frameworks, and evaluation systems [3,4,5, 10, 31,32,33].

Reviews of capacity strengthening programs have noted difficulties in equipping scholars to work within structural challenges at institutional and country levels. Such challenges include a lack of funding, salary support, protected time to conduct research, research personnel and infrastructure, and mentorship [34,35,36,37,38,39,40,41,42,43]. Without adequate financial support, graduates are unable to support their research endeavors and may supplement their salary through consultancies or clinical engagements, thus decreasing the amount of time they can dedicate to the development and implementation of research. A lack of research administrative support as well as other research infrastructure, such as laboratory equipment and internet, can hinder research productivity. A lack of support from institutional leadership and mentors in the field can also dissuade enthusiastic researchers from pursuing their work. Further, due to differences in research environments and resources between LMICs and HICs, outcome measures commonly used in HICs, including publications in peer-reviewed journals, conference presentations, and funded grant applications, may not reflect accurately the research capacity and productivity in LMICs.

Noting the challenges that LMIC researchers encounter in sustaining a research career and inadequacies of traditional productivity metrics, Cooke created a framework to guide and evaluate research capacity strengthening programs [44]. The framework was built upon six principles that include building skills and confidence; remaining close to scholars’ practice; linking with networks and growing collaborations; improving health outcomes through dissemination of research findings; providing structures for sustainability and continuity; and supporting scholars’ continued research. Each of these principles operate at individual, team, organization, and supra-organizational levels.

In 2011, the Vanderbilt Institute in Research Development and Ethics (VIRDE) program was launched to support junior investigators in LMICs. VIRDE utilized Cooke’s six principles at the individual level to build a unique program that trains investigators in grant writing and research ethics, with an aim for program scholars to attain funding support, sustain their research career, and become research leaders who positively impact health outcomes through policy change. The four-week, intensive, mentored practicum takes place in-person at Vanderbilt University in Nashville, Tennessee, USA. VIRDE includes state-of-the-art didactic sessions promoting competencies in grant writing and the responsible conduct of research. These sessions are coupled with dedicated time for hands-on, mentored practical skills building in grant writing, culminating in a grant application that is ready for submission for external funding. Scholars also engage in laboratory rotations, graduate-level courses, and regular meetings with a personalized mentoring committee.

Evidence-based quality improvement is an essential element of the VIRDE program. Annual program evaluations inform program modifications and enhancements for the next iteration. Additional bi-annual check-ins with program alumni have contributed to quality improvement efforts and served to maintain networks and support alumni. To assess long-term impact, a program evaluation questionnaire utilizing Cooke’s principles was sent to all VIRDE alumni during the tenth year of the program. This paper illustrates the results of the program evaluation, assesses the impact of the program over the last decade, and describes lessons learned.

Methods

Participants

The VIRDE program was designed for biomedical and public health investigators in LMICs. Initially the program was developed to bolster research independence of junior faculty affiliated with Vanderbilt Institute for Global Health (VIGH) partner institutions in Africa, Asia, and Latin America, but has since expanded to include scholars affiliated with additional institutions. Partner institutions in LMICs manage the initial round of the selection process, identifying appropriate candidates. Selected applicants then complete an online application, including submission of their curriculum vitae or National Institutes of Health (NIH)-style biosketch, a draft proposal based on an NIH R21 grant format, and support letters from their in-country mentors. Prior to selection, applicants are required to give a proposal presentation online to the VIRDE Selection Committee. Priority is given to applicants who submit a compelling grant proposal idea and identify committed mentors from their home institution and Vanderbilt. Scholarships for VIRDE participants are supported by institutional funds and VIGH collaborative US government and foundation-sponsored training and research grants with LMIC partner institutions.

Curricular elements

Cooke’s six principles of research capacity strengthening were incorporated into the VIRDE curriculum through seminars, mentoring teams, and on-going post-program collaborations. The VIRDE curriculum includes over 40 contact hours of specially tailored seminars in grant writing, grant administration, research ethics, and career development taught in person or virtually by Vanderbilt faculty and senior staff, VIRDE alumni, and LMIC partner faculty. Examples of grant writing seminars include funding strategies, effective writing of standard grant sections, and administrative elements of grant management. Research ethics seminars cover topics related to the fundamentals of research ethics, ethical research design, international standards of clinical trials, and ethics of authorship and collaborative partnerships. Career development seminars focus on leadership and strategies for success as an academic researcher.

Training program structure

During the program, scholars participate daily in several hours of didactic workshops led by VIRDE faculty. When not in workshops, scholars hone their grant proposal and engage in various capacity strengthening activities at Vanderbilt, including attending courses and seminars, visiting laboratories and research cores, and meeting with potential collaborators. Scholars are supported by dedicated mentor teams from their home country and Vanderbilt-based mentors via meetings held several times each week during the course. With guidance from their mentors, scholars develop a grant proposal in stages by completing weekly writing assignments. The course concludes with a mock NIH-style grant review of the proposals by a committee comprised of Vanderbilt faculty, VIRDE alumni, VIRDE scholars, and invited experts. Scholars leave the program with a strong draft of a grant proposal and a submission plan. Upon returning to their home country, scholars continue to receive support from their mentoring team and administrative technical assistance from Vanderbilt staff.

Evaluation and analysis

To assess the impact that the VIRDE program has had on the research careers of program alumni over the past 10 years, the authors developed an online program evaluation that was sent to all VIRDE alumni (n = 58). REDCap, a secure online platform for survey development and database management [45, 46], was used to design the survey instrument and email survey invitations and reminders. The instrument had 223 fields to query respondents on research engagement, grant productivity before and after VIRDE, career trajectory, leadership roles, collaborative activities, VIRDE program elements, and knowledge gained in grant writing and research ethics. Answer fields included checkboxes and open-ended responses. For questions related to grant writing and research ethics knowledge, respondents were asked to rate their knowledge prior to and after attending VIRDE on a five-point scale, ranging from strongly disagree (one) to strongly agree (five) for 10 elements of grant writing and a four-point scale, ranging from uninformed (one) to expert (four) for 18 elements of research ethics.

Descriptive statistics, including means and total counts, were used to analyze responses for the questions with checkboxes. Total counts were used to compare responses about grant awards before and after VIRDE. Where applicable, total counts were converted to a percentage of the total respondents for that question. Changes in knowledge scores were determined by calculating the mean response value for each question, both before and after VIRDE. Then, the pre-VIRDE mean was subtracted from the respective post-VIRDE mean for each question and the mean change was converted to a percentage. To analyze changes in knowledge before and after VIRDE, paired sample t-tests were conducted to determine statistical significance. Heat maps were created to visually highlight change in knowledge.

The authors have served as VIRDE instructors/mentors and the first author is also the program director and co-founder. To establish distance and maintain neutrality, data was analyzed by research assistants who were new to the program and survey responses were deidentified. Respondents provided their consent to participate in this evaluation and were assured of confidentiality in their responses. The study protocol and evaluation instrument were approved by the Vanderbilt University Institutional Review Board (#200133).

Results

Demographics

Fifty-eight LMIC academic biomedical investigators, including NIH-Fogarty International Center training grant alumni participated in VIRDE from 2011 to 2019, of which 34% were women. Forty-six alumni completed the survey. Two additional alumni began the survey but did not complete it, bringing the total responses for some questions to 47 or 48, depending on where the respondent stopped. With 48 out of 58 responses, the sample has a margin of error of 5% at the 90% confidence level. Of the survey respondents (n = 48), 68.8% were male and 31.3% were female (Table 1). A majority of participants held a terminal degree including an MD, MBBS, or equivalent (39.6%) or a PhD (37.5%). When stratifying the highest level of education achieved by sex, slight differences arose. More women than men (46.7% versus 36.4%, respectively) held an MD, MBBS, or equivalent degree as their highest degree, while more men than women (45.5% versus 20.0%, respectively) held a PhD.

Table 1 Demographic information of survey respondents (n = 48), Vanderbilt Institute for Research Development and Ethics (VIRDE)

Roughly 90% of respondents came from sub-Saharan Africa, with over 80% residing in one of four countries, Zambia (31.3%), Nigeria (20.8%), Mozambique (16.7%), or Ghana (12.5%). Other countries included Brazil, Bangladesh, China, Kenya, Pakistan, and Tanzania. All but one respondent has remained in their home country since completion of VIRDE.

Most respondents (77.1%) reported being employed in academia. Smaller percentages reported working in government institutions (20.8%) or non-governmental organizations (14.6%). Almost all respondents (92.0%) reported currently working at the same type of organization as they did during VIRDE, with many (88.0%) having advanced in their career stage since their participation in VIRDE. All respondents except one “agreed” or “strongly agreed” with the statement “VIRDE contributed to my career advancement.”

Research engagement and grant writing

All respondents reported they currently work in some research capacity, although the hours devoted to research differed. The majority of respondents (62.5%) reported spending approximately 30 to 59% of their professional work time on research. Smaller proportions of respondents reported spending greater than 60% or less than 30% of their time on research (27.1 and 10.4% respectively).

Respondents were asked to select factors that enabled them to pursue research. The most common selected factor was “a personal desire to do research” (70.2%). Other factors selected by at least half of respondents included “a positive research culture at their institution” (64.6%) and “mentorship” (50%).

Respondents were requested to select factors that had the greatest impact on their ability to successfully develop research grants while participating in VIRDE. “Mentoring during VIRDE” and “VIRDE lectures” were the most selected responses (89.1, 78.3% respectively). “Personal motivation” (56.5%), “protected work time during VIRDE” (45.7%), “interactions with VIRDE peers” (39.1%), and “network connections developed during VIRDE” (32.6%) were also listed as enablers of their success.

Knowledge in grant writing and research ethics

Respondents reported on a scale of 1 (strongly disagree) to 5 (strongly agree) their grant writing knowledge across ten competencies pre- and post-VIRDE (Fig. 1). The respondents’ ratings of their post-VIRDE grant writing knowledge were significantly greater than the pre-VIRDE ratings for all grant writing knowledge questions (Paired t-test: p < 0.001). The average grant knowledge score pre-VIRDE was 3.0 and post-VIRDE was 4.4, an increase of 44%. The largest knowledge gains were in “reviewing a grant” (77.5% increase), “creating a biosketch or CV” (52.1%), and “writing the resources and environment section” (50.4%).

Fig. 1
figure 1

Heat Map of Grant Writing Knowledge Gained, Vanderbilt Institute for Research Development and Ethics (VIRDE)

Respondents ranked their level of knowledge on ten grant writing competencies using a five-point Likert-scale (1/red = strongly disagree; 5/green = strongly agree). Paired sample t-test for composite comparison of pre/post test scores: p < 0.001.

Respondents also reported their pre- and post-VIRDE knowledge about research ethics across 18 competencies on a scale of 1 (uninformed) to 4 (expert) (Fig. 2). The respondents’ ratings of their post-VIRDE knowledge of research ethics were significantly greater than the pre-VIRDE ratings for all grant writing knowledge questions (Paired t-test: p < 0.001). The average research ethics score pre-VIRDE was 2.4 and post-VIRDE was 3.2, a 33% increase. In the pre-VIRDE section, there were 78 “uninformed” responses, compared to just 4 in the post-VIRDE section. The biggest changes were in “US policies and regulations on research ethics” (55.3% increase), “responsibilities of mentors and students in research” (44.8%), and “Good Clinical Practice (GCP) Standards” (41.8%). Additionally, 86.7% of participants indicated that VIRDE impacted their knowledge of these ethics topics “a lot.”

Fig. 2
figure 2

Heat Map of Ethics Knowledge Gained, Vanderbilt Institute for Research Development and Ethics (VIRDE)

Respondents ranked their level of knowledge on 18 research ethics competencies using a four-point Likert-scale (1/red = uniformed; 4/green = expert). Paired sample t-test for composite comparison of pre/post test scores: p < 0.001.

Sharing knowledge and collaboration

Respondents also reported increases in mentoring and teaching of others in their home institutions about grant writing. Only two scholars (4.3%) reported teaching courses about grant writing prior to VIRDE, and that number increased to 12 (25.5%) after VIRDE. Similarly, prior to VIRDE, eight respondents (17.0%) mentored others in grant writing, which increased to 31 (67.4%) post-VIRDE.

Before VIRDE, 36 respondents (76.6%) reported collaborating on research at organizational, regional, and/or international levels. After VIRDE, 46 (97.9%) respondents reported collaborating on at least one of these levels. The rate of collaboration increased by 27.3% at the organizational level, 40.0% at the regional level, and 44.8% at the international level.

Grant productivity

Of the 47 respondents, only 15 (31.9%) had ever submitted a grant proposal for funding prior to their participation in VIRDE (Table 2). Pre-VIRDE, these 15 respondents submitted 53 proposals, of which 36 (67.9%) were awarded. However, in the period following participation in VIRDE, 39 (82.9%) respondents had submitted a total of 147 grants, of which 67 (45.6%) have been awarded at the time of the evaluation. Sixty-four percent of those who submitted at least one grant post-VIRDE were awarded at least one grant. The average grant award success rate per respondent post-VIRDE was 46.8%. The average time from the respondent’s participation in VIRDE to an awarded grant was roughly 2 years.

Table 2 Grant Productivity and Leadership, Vanderbilt Institute for Research Development and Ethics (VIRDE)

We analyzed the types of funding agencies that supported the awarded grants. United States Government (USG) agencies supported around 40% of grants both before and after VIRDE. However, post-VIRDE there was increased diversity in other sources of funding, such as foundations and pharmaceutical companies, and about 18% came from national organizations, which was an increase over pre-VIRDE. Almost two-thirds (63.6%) of the respondents’ first awarded grant post-VIRDE was a one-to-two-year grant.

We evaluated demographic differences between respondents who did submit (39, 83.0%) and those that had not yet submitted (8, 17.0%) grants after VIRDE (Table 3). Sex was equally split among those that did not submit grants post-VIRDE, however, this distribution represents a higher proportion of females not submitting grants since only one-third of our respondents were female. Two of the eight alumni who had not yet submitted a grant proposal only recently participated in VIRDE in 2019. Three of the eight are employed in academia, three with a government institution, and two with an international non-government organization. Of those who did not submit grants, four hold a master’s degree as their highest degree, three hold a MBBS/MBChB degree, and one holds a bachelor’s degree. All respondents holding PhD degrees had submitted a grant proposal, as did 33 of the 37 (89.2%) respondents working in academia.

Table 3 Demographic differences between trainees who submitted grants and those who did not submit grants post-VIRDE

Leadership roles and policy change

All respondents serve or served as a PI, Co-PI, or Multi-PI on at least one of their awarded grants. Most respondents (37, 77.1%) held leadership roles at their organizations. Among those working in academia, 13 (35.1%) respondents serve or served as a Department Chair, Dean, Deputy Dean of Research, or in another similar administrative leadership capacity. No respondents held solely a national or international leadership position, but nine (19%) held leadership roles at organizational, national, and international levels. More individuals reported that their research outputs impacted policy changes post-VIRDE (20, 42.6%) than pre-VIRDE (15, 31.9%).

In their own words: the impact of VIRDE

Policy changes

Post-VIRDE, 20 respondents reported that their research contributed to policy change. In open-ended responses, they described changes made at three levels: clinic management and hospital; local and national; and regional and international. In clinic management and at the hospital, respondents helped develop new guidelines and protocols for the clinical management and treatment of diseases across a variety of medical specialties. At local and national levels, their research helped influence the adoption of new standards of care for sickle cell disease, change HIV treatment guidelines, advance a testing platform for syphilis during pregnancy, and provide free hydroxyurea for stroke prevention. Further, respondents helped improve tobacco control policies and establish a national non-communicable disease research database. Internationally, one respondent’s research helped change the World Health Organization (WHO) guidelines on the medical eligibility criteria for contraceptive use. Another respondent is helping to establish a digital surveillance platform for anti-microbial resistance in sub-Saharan Africa, while another wrote that “results from our multi-center stroke prevention trial will change the narrative on and practice of stroke prevention in children with sickle cell disease in resource-constrained regions.”

Career advancement

When asked about the impact that VIRDE had on their career advancement, open-ended responses (n = 43) were centralized around the skills and knowledge respondents gained that influenced their ability to write fundable grants. As one respondent explained, these improved research outputs “enhanced my career and promotion prospects” and other respondents were able to “advance from lecturer to senior lecturer.” These sentiments were referenced in similar ways by 13 respondents (30.2%). Seventeen respondents (39.5%) wrote about their success in receiving grants and 9 (20.9%) wrote about increased knowledge and skills to apply for grants and receive research funding. Through VIRDE, they “have learnt new approaches to searching different funding sources, (and the) technical issues of NIH grants.” Other respondents commented on awards they received to attend additional training programs and enrolment in doctoral programs because of their increased competencies from VIRDE.

Some respondents wrote about increased motivation, perseverance, and focus, with descriptions like “VIRDE motivated me to make progress,” “I learnt how to persist despite difficulties,” and “I am more focused on my academic career.” Respondents also noted ways that the training enhanced their teaching and outreach in the community, thus extending the impact of VIRDE. One respondent noted, “I turned (into) a grant mobilizer and community leader in research and health program delivery.

Discussion

Findings

Based on evaluation data, VIRDE scholars develop skills and knowledge in grant writing and research ethics during this month-long immersive training program. While at VIRDE, they grow their professional networks and return to their home institutions where many successfully write and submit grants. For some scholars, this grant-funded research has resulted in changes to health care practice and policies. Alumni mentor and teach grantsmanship to colleagues, sustaining and promoting a research culture in their institutions.

Given the differences in research environments between LMICs and HICs, outcome measures commonly used in HICs, including number of publications in peer-reviewed journals, conference presentations, and funded grant applications, may not reflect accurately research capacity and productivity for scholars in LMICs. Cooke’s framework for research capacity strengthening provided an objective, non-traditional tool to assess the VIRDE program. Success of alumni and the program were broadly measured by scholars’ knowledge and skill enhancement, increased research collaborations, sustained engagement in research, and impact of research grants on health care practice and policies.

Gains in grant writing and research ethics knowledge as well as an increase in mentoring and teaching of these skills suggest that VIRDE scholars built skills and confidence in grant writing during the program. Respondents reported their largest gains in grant writing knowledge were related to reviewing a grant proposal and in the writing of specific sections of a grant proposal. Lectures and assignments throughout the one-month practicum focused on honing the scholars’ skills in developing each section of a grant application, culminating in a mock NIH-style grant review. Throughout the process of developing a grant proposal, scholars received frequent guidance from their mentoring committee. Reported gains in knowledge along with high ranking of VIRDE mentorship and lectures affirm the utility of hands-on, mentored practice combined with instruction.

We found a correlation between participation in VIRDE and increased research collaborations with international partner institutions. Partnerships are the foundation of the VIRDE program. VIRDE scholars are selected from institutions with existing collaborations with Vanderbilt University, as such it is not surprising that respondents reported being engaged in international collaborations. However, we found that post-VIRDE, the number of scholars engaged in international as well as institutional and national collaborations increased. The greatest increase in collaborations was at the international level, which could be attributed to VIRDE’s multidisciplinary and multi-country cohorts of scholars who work closely together during the month-long training, as well as scholars’ access to new mentors and exposure to research facilities at Vanderbilt during VIRDE.

The VIRDE program was founded upon a vision of training continuity and research sustainability. Survey results highlight the ripple effects of knowledge transfer as VIRDE alumni increased their engagement in teaching and mentoring in grant writing at their institutions. Sharing knowledge about grant writing has a two-fold impact. First, colleagues, mentees, and trainees learn about and improve their skills in grant writing, thus widening the impact of the program without additional program resources. Second, through teaching and mentoring, VIRDE scholars solidify their knowledge and establish themselves as leaders in grant writing. VIRDE alumni receive all training resources, including course slides. Providing course materials and continued technical assistance to alumni equips them to develop their own grantsmanship trainings adapted to their setting, which has been accomplished by some alumni.

Through increased grant funding, opportunities are created for alumni to both focus on and sustain their research careers. The data revealed that nearly three times more grants were submitted post-VIRDE, including 24 scholars who submitted their first grant proposal. In addition, post-VIRDE the diversity of funding organizations from which scholars applied to for grant funding increased, demonstrating new paths to sustainability and research independence for many individuals. Almost two-thirds of scholars who submitted grant proposals were awarded at least one grant and overall, half of submitted grants were funded. Respondents highlighted renewed focus, motivation, and perseverance in their pursuit of a research career as a result of participating in VIRDE. Such character growth can have a lasting positive impact on a scholar’s career trajectory. Incorporating mentoring and training to enhance these traits may contribute to scholars’ successes in grant writing, leadership, and research dissemination.

A substantial proportion of respondents have advanced in their career stage, serve in leadership roles, and continue to work in academia in their country of origin, contributing to a low rate of “brain drain.” Brain drain is common in LMICs as trainees often leave their country for career opportunities abroad. However, our data suggests that VIRDE equips scholars with skills, confidence, and networks needed to create the opportunities that lead to sustaining a research career while remaining in their home countries. Applicants are vetted first by an in-country team comprised of principal investigators who have existing partnerships with Vanderbilt before applying to VIRDE. This in-country process likely increases the probability of supported scholars who are connected to local networks to remain in academic research. Local collaboration for training is helpful to create sustainable, supportive research environments for scholars post-training.

Applicants are vetted for their ability to generate innovative research that is relevant to their setting. While traditional research dissemination metrics focus on publications in academic journals, we focus on the ability to sustain a research career through grant funding and for research to improve practice and health outcomes. Through evidence generated in their grant funded research, scholars reported changing practice, implementing policies, and impacting patients’ quality of life. Notably, scholars described that their research contributed to improving medical diagnostic and treatment protocols and other health-related policies in their regions, demonstrating the relevance and importance of their research. Scholars also contributed to international policy decision making groups, broadening the impact of their research to improve practice in other regions. These output metrics could be attributed to scholars’ increased grant productivity, collaborations, and confidence post-VIRDE, revealing the ability of this program to serve as a catalyst for scholars to develop research that is close to practice and responds to community and patient needs.

Implications

We have highlighted elements beyond traditional metrics that indicate success of alumni and this program. These metrics, which include enhancing grant writing skills; expanding collaborations and roles as mentors, teachers, and leaders in grant writing; remaining in research; submitting grants; and impacting local and international practice, build upon Cooke’s framework and could be used by other programs to measure success. Key program elements that contributed to the program’s success include 1) a rigorous application and selection process led by LMIC partners requiring applicants to submit a draft grant proposal as part of the application process; 2) a curriculum based on applicable grant-writing skills taught by senior research faculty and staff combined with proposal development milestones; 3) committed in-country and U.S. based mentorship teams during and after VIRDE; 4) protected writing time away from competing work duties; and 5) an immersive cohort experience that provided participants with expanded professional networks.

VIRDE is a one-month program and grant development and submission can take months to years. Hence, based on the evaluation results, participating in VIRDE could be considered as a catalyst for success in grant writing. We acknowledge that VIRDE may not be the sole reason for their successes. Therefore, we queried scholars on their perception of VIRDE’s impact on their career and research productivity, as well as other factors that contributed to their success outside of VIRDE. Among the factors that enabled them to pursue research, at least half of respondents selected “a personal desire to do research,” “a positive research culture at their institution,” and “mentorship.” Success as an independent investigator also requires intrinsic motivation, determination, and perseverance, especially in a LMIC setting where respondents reported systemic challenges.

As we plan for the next 10 years, we are using this data to develop programming that continues to be relevant and effective. To date, only 31% of VIRDE participants were women. We recognize that VIRDE’s current format, requiring participants to spend one-month away from home, poses a challenge for gender equity among participants. Additionally, a one-month program in the U.S. can be costly and a prohibiting factor for researchers in LMICs. At present, VIRDE requires a funding source for participant scholarships as well as institutional support for program instructors and mentors. VIRDE scholars have predominantly been supported by NIH training grants, therefore limiting the number and breadth of participants. To address gender equity and cost, we are exploring incorporating online modules to decrease expense and duration of time in the U. S for those who cannot attend the entire month in-person. Further, for partner institutions which have a nucleus of VIRDE alumni and a more mature research portfolio, we are exploring transitioning some, or all, of the program elements to be taught in-country. We found that post-VIRDE, 25% of alumni taught grant-writing courses and 67% provided grant writing mentoring, demonstrating feasibility of expanding VIRDE through alumni trainers. With these cadres of research scholars trained in grant writing, VIRDE will continue to build individual grant writing skills among future participants while supporting alumni to develop and lead courses in the next phase of VIRDE. With networks of individual research scholars trained in grant writing, strengthening institutional research systems is the next step. We are working with alumni to develop programs at their institutions that strengthen indigenous grants management support [47].

Limitations

We noted limitations in our data collection and analysis. Data related to knowledge and behavior were self-reported. Therefore, we relied on an accurate representation from respondents about their level of knowledge, participation in activities, and grant submission and awards. We also asked respondents to recall their knowledge and activities pre-VIRDE and differentiate that information from post-VIRDE knowledge and behavior. Participant recall on retrospective data may be biased. Additionally, respondents may have provided biased responses knowing that the survey came from the program director with whom many alumni are still in contact and that responses may be identifiable due to the relatively small sample size. Respondents may have wished to present their knowledge, skills, and outputs in a positive light. However, we believe that knowing the survey’s origins may have increased their willingness to participate in the survey, thus increasing the response rate. The survey included over 200 answer fields and survey fatigue may have affected responses towards the end of the survey. Since not all alumni responded, the actual program impact could be different. In reflecting on the survey design, respondents were not asked about challenges and areas for improvement associated with participating in the program, writing grants, or their research career. Such questions would have provided critical feedback and additional insight to VIRDE and grant writing for these researchers. Finally, these results are applicable to VIRDE scholars and findings may not be generalizable to the larger population.

Conclusions

Our program evaluation data indicate that the VIRDE program contributed to increases in scholars’ knowledge in grant writing and research ethics. With increased knowledge, skills, and confidence in those areas, teaching and mentoring activities increased. After the program, scholars also increased their collaborations at local, national, and international levels and held more leadership roles. Fulfilling the aims of the program, scholars’ rates of grant submissions and awards increased, reflecting scholars’ ability to grow and sustain their research career. Scholars’ funded research also influenced community health outcomes and national and international health policies. Over the past decade, VIRDE has strengthened the research grant writing capacities of nearly six dozen biomedical investigators from LMICs, and has impacted positively on trainees’ health structures and research systems on many levels. Our experience can be used to inform the development, implementation, and long-term evaluation of similar research capacity training programs in under-resourced settings.

Availability of data and materials

The datasets used and/or analyzed during the current study are available by accessing the publicly available repository https://vumc.box.com/s/muztsnpjfsvn9ykn3r6hqarbwsdxp80a.

Abbreviations

LMIC:

Low- and middle-income country

HIC:

High-income country

NIH:

National Institutes of Health

VIRDE:

Vanderbilt Institute in Research Development and Ethics

References

  1. Abbafati C, Machado DB, Cislaghi B, et al. Global burden of 369 diseases and injuries in 204 countries and territories, 1990–2019: a systematic analysis for the global burden of disease study 2019. Lancet. 2020;396(10258):1204–22. https://doi.org/10.1016/S0140-6736(20)30925-9.

    Article  Google Scholar 

  2. Bates I, Boyd A, Aslanyan G, Cole DC. Tackling the tensions in evaluating capacity strengthening for health research in low- and middle-income countries. Health Policy Plan. 2015;30(3):334–44. https://doi.org/10.1093/heapol/czu016.

    Article  Google Scholar 

  3. Franzen SRPP, Chandler C, Lang T, Samuel D, Franzen RP. Health research capacity development in low and middle income countries: reality or rhetoric? A systematic meta-narrative review of the qualitative literature. BMJ Open. 2017;7:e012332. https://doi.org/10.1136/bmjopen-2016-012332.

    Article  Google Scholar 

  4. Kramer B, Libhaber E. Closing the barrier between disease and health outcomes in Africa through research and capacity development. Glob Health Action. 2018;11(1):1425597. https://doi.org/10.1080/16549716.2018.1425597.

    Article  Google Scholar 

  5. Morel T, Maher D, Nyirenda T, Olesen OF. Strengthening health research capacity in sub-Saharan Africa: mapping the 2012-2017 landscape of externally funded international postgraduate training at institutions in the region. Glob Health. 2018;14(77). https://doi.org/10.1186/s12992-018-0395-0.

  6. Torondel B, Balls E, Chisenga CC, et al. Experiences of capacity strengthening in sanitation and hygiene research in Africa and Asia: the SHARE research consortium. Heal Res Policy Syst. 2019;17(1):1–10. https://doi.org/10.1186/s12961-019-0478-2.

    Article  Google Scholar 

  7. Pillai G, Chibale K, Constable EC, et al. The next generation scientist program: capacity-building for future scientific leaders in low-and middle-income countries. BMC Med Educ. 2018;18(233):1–11. https://doi.org/10.1186/s12909-018-1331-y.

    Article  Google Scholar 

  8. Airhihenbuwa CO, Ogedegbe G, Iwelunmor J, et al. Claim your space: leadership development as a research capacity building goal in global health. Health Educ Behav. 2016;43(1):17S–24S. https://doi.org/10.1177/1090198116633455.

    Article  Google Scholar 

  9. Ezeh A, Lu J. Transforming the institutional landscape in sub-Saharan Africa: considerations for leveraging Africa’s. research capacity to achieve socioeconomic development. Center for Global Development. 2019. Policy paper147. https://www.cgdev.org/sites/default/files/transforming-institutional-landscape-sub-saharan-africa-considerations-leveraging-africa.pdf.

  10. Dean L, Gregorius S, Bates I, Pulford J. Advancing the science of health research capacity strengthening in low-income and middle-income countries: a scoping review of the published literature, 2000–2016. BMJ Open. 2017;7(12). https://doi.org/10.1136/bmjopen-2017-018718.

  11. Chio KS. Effective practices in providing online, in-service training to health professionals in low-resource settings. Int J Train Dev. 2012;16(3):228–34. https://doi.org/10.1111/j.1468-2419.2012.00406.x.

    Article  Google Scholar 

  12. Atkins S, Varshney D, Meragia E, Zwarenstein M. “Research clinics”: online journal clubs between south and north for student mentoring. Glob Health Action. 2016;9(1):30434. https://doi.org/10.3402/gha.v9.30434.

    Article  Google Scholar 

  13. Daniels J, Farquhar C, Nathanson N, et al. Training tomorrow’s global health leaders: applying a transtheoretical model to identify behavior change stages within an intervention for health leadership development. Glob Health Promot. 2014;21(4):24–34. https://doi.org/10.1177/1757975914528726.

    Article  Google Scholar 

  14. Monroe-Wise A, Mashalla Y, O ‘malley G, et al. Training tomorrow’s leaders in global health: impact of the Afya bora consortium fellowship on the careers of its alumni. BMC Med Educ 2016;16(241). doi:https://doi.org/10.1186/s12909-016-0750-x.

  15. Bolden R, Kirk P. African leadership: surfacing new understandings through leadership development. Int J Cross-cult Manag. 2009;9(1):69–86. https://doi.org/10.1177/1470595808101156.

    Article  Google Scholar 

  16. Rowe LA, Brillant SB, Cleveland E, et al. Building capacity in health facility management: guiding principles for skills transfer in Liberia. Hum Resour Health. 2010;8:1–7. https://doi.org/10.1186/1478-4491-8-5.

    Article  Google Scholar 

  17. Kwamie A, Dijk H van, Agyepong IA. Advancing the application of systems thinking in health: realist evaluation of the leadership development Programme for district manager decision-making in Ghana. Heal Res Policy Syst 2014;12(1):1–12. doi:https://doi.org/10.1186/1478-4505-12-29.

  18. Matovu JK, Wanyenze RK, Mawemuko S, et al. Building capacity for HIV/AIDS program leadership and management in Uganda through mentored fellowships. Glob Health Action. 2011;4. https://doi.org/10.3402/gha.v4i0.5815.

  19. Noormahomed EV, Carrilhod C, Ismaild M, et al. The medical education partnership initiative (MEPI), a collaborative paradigm for institutional and human resources capacity building between high- and low- and middle-income countries: the Mozambique experience. Glob Health Action. 2017;10(1). https://doi.org/10.1080/16549716.2017.1272879.

  20. White M, Close K. Lasting impact: insights from a surgical mission-based mentoring training programme in the republic of Congo. BMJ Glob Health. 2016;1:e000102. https://doi.org/10.1136/bmjgh-2016-000102.

    Article  Google Scholar 

  21. Ogundahunsi OAT, Vahedi M, Kamau EM, et al. Strengthening research capacity—TDR’s evolving experience in low- and middle-income countries. PLoS Negl Trop Dis. 2015;9(1):e3380. https://doi.org/10.1371/journal.pntd.0003380.

    Article  Google Scholar 

  22. Adedokun B, Nyasulu P, Maseko F, et al. Sharing perspectives and experiences of doctoral fellows in the first cohort of consortium for advanced research training in Africa: 2011–2014. Glob Health Action. 2014;7(1):25127. https://doi.org/10.3402/gha.v7.25127.

    Article  Google Scholar 

  23. Izugbara CO, Kabiru CW, Amendah D, et al. “It takes more than a fellowship program”: reflections on capacity strengthening for health systems research in sub-Saharan Africa. BMC Health Serv Res. 2017;17(Suppl 2):696. https://doi.org/10.1186/s12913-017-2638-9.

    Article  Google Scholar 

  24. Färnman R, Diwan V, Zwarenstein M, Atkins S. Successes and challenges of north-south partnerships - key lessons from the African/Asian regional capacity development projects. Glob Health Action. 2016;9(1):30522. https://doi.org/10.3402/GHA.V9.30522.

    Article  Google Scholar 

  25. Reeder JC, Guth JA. What have we learned from 40 years of supporting research and capacity building? PLoS Negl Trop Dis. 2015;9(1):9–12. https://doi.org/10.1371/journal.pntd.0003355.

    Article  Google Scholar 

  26. Decroo T, Van den Bergh R, Kumar AMV, et al. Blended SORT-IT for operational research capacity building: the model, its successes and challenges. Glob Health Action. 2018;11(1):1469215. https://doi.org/10.1080/16549716.2018.1469215.

    Article  Google Scholar 

  27. Kilmarx PH, Katz F, Razak MH, Palen J, Cheever LW, Glass RI. The medical education partnership initiative: strengthening human resources to end AIDS and improve health in Africa. Acad Med. 2018. https://doi.org/10.1097/ACM.0000000000002489.

  28. Godoy-Ruiz P, Cole DC, Lenters L, McKenzie K. Developing collaborative approaches to international research: perspectives of new global health researchers. Glob Public Health. 2015;11(3):253–75. https://doi.org/10.1080/17441692.2014.999814.

    Article  Google Scholar 

  29. Atkins S, Marsden S, Diwan V, Zwarenstein M. North-south collaboration and capacity development in global health research in low-and middle-income countries - the ARCADE projects. Glob Health Action. 2016;9(1):30524. https://doi.org/10.3402/gha.v9.30524.

    Article  Google Scholar 

  30. Kühl S. Capacity development as the model for development aid organizations. Dev Chang. 2009;40(3):551–77. https://doi.org/10.1111/j.1467-7660.2009.01538.x.

    Article  Google Scholar 

  31. Bates I, Akoto AYO, Ansong D, et al. Evaluating health research capacity building: an evidence-based tool. PLoS Med. 2006;3(8):1224–9. https://doi.org/10.1371/journal.pmed.0030299.

    Article  Google Scholar 

  32. Simosi M. The moderating role of self-efficacy in the organizational culture-training transfer relationship. Int J Train Dev. 2012;16(2):92–106. https://doi.org/10.1111/j.1468-2419.2011.00396.x.

    Article  Google Scholar 

  33. ESSENCE on Health Research. Seven principles for strengthening research capacity in low- and middle-income countries: simples ideas in a complex World; 2014.

    Google Scholar 

  34. Varadaraj V, Ranjit A, Nwadiuko J, et al. Towards diaspora-driven research capacity strengthening in low-and middle-income countries: results from India and Nepal. Int Health. 2018. https://doi.org/10.1093/inthealth/ihy076.

  35. Walsh A, Brugha R, Byrne E. “The way the country has been carved up by researchers”: ethics and power in north-south public health research. Int J Equity Health. 2016;15(204). https://doi.org/10.1186/s12939-016-0488-4.

  36. Laudel G. The art of getting funded: how scientists adapt to their funding conditions. Sci Public Policy. 2006;33(7):489–504. https://doi.org/10.3152/147154306781778777.

    Article  Google Scholar 

  37. Ager A, Zarowsky C. Balancing the personal, local, institutional, and global: multiple case study and multidimensional scaling analysis of African experiences in addressing complexity and political economy in health research capacity strengthening. Heal Res Policy Syst. 2015;13(5):1–9. https://doi.org/10.1186/1478-4505-13-5.

    Article  Google Scholar 

  38. Nordling L. Science without borders: coming home. Nature. 2018;562(7727):S58–61.

    Article  Google Scholar 

  39. Kumwenda S, Niang EHA, Orondo PW, et al. Challenges facing young African scientists in their research careers: a qualitative exploratory study. Malawi Med J. 2017;29(1). https://doi.org/10.4314/mmj.v29i1.1.

  40. Harsh M, Bal R, Wetmore J, Zachary GP, Holden K. The rise of computing research in East Africa: the relationship between funding, capacity and research community in a nascent field. Minerva. 2018;56:35–58. https://doi.org/10.1007/s11024-017-9341-1.

    Article  Google Scholar 

  41. Kiat Kok S, McDonald C. Underpinning excellence in higher education – an investigation into the leadership, governance and management behaviours of high-performing academic departments underpinning excellence in higher education – an investigation int. Stud High Educ. 2017;42(2):210–31. https://doi.org/10.1080/03075079.2015.1036849.

    Article  Google Scholar 

  42. Ezeanolue EE, Menson WNA, Patel D, et al. Gaps and strategies in developing health research capacity: experience from the Nigeria implementation science Alliance. Heal Res Policy Syst. 2018;16(10). https://doi.org/10.1186/s12961-018-0289-x.

  43. Chu KM, Jayaraman S, Kyamanywa P, Ntakiyiruta G. Building research capacity in Africa: equity and global health collaborations. PLoS Med. 2014;11(3):e1001612. https://doi.org/10.1371/journal.pmed.1001612.

    Article  Google Scholar 

  44. Cooke J. A framework to evaluate research capacity building in health care. BMC Fam Pract. 2005;6:1–11. https://doi.org/10.1186/1471-2296-6-44.

    Article  Google Scholar 

  45. Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap) - a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42:377–81.

    Article  Google Scholar 

  46. Harris PA, Taylor R, Minor BL, et al. The REDCap consortium: building an international community of software platform partners. J Biomed Inform. 2019;95:103208.

    Article  Google Scholar 

  47. Aliyu MH, Iliyasu Z, Ingles DJ, Cassell HM, Lloyd WH, Ahonkhai AA, et al. The V-RAMP program: building research administration and management capacity in Nigeria. J Glob Health Rep. 2021;5:e2021051.

    Google Scholar 

Download references

Acknowledgements

• VIRDE Alumni, instructors, mentors

• Dr. Elizabeth Heitman, Dr. Sten H. Vermund, Dr. Michael R. DeBaun, Dr. Megan E. Pask

• Statistical analysis: Cameron Richey, Chase Stober, Megan Gabruk, Tessa Bales

Funding

This work was supported by the Fogarty International Center and the National Institute of Neurological Disorders and Stroke of the U.S. National Institutes of Health, D43TW001035, D43TW009744, D43TW009745, R25 TW009722, R25TW009337, D43TW009337, R01NS094041, G11TW011819, D43TW011544, UL1TR000445. The content is solely the responsibility of the authors and does not necessarily represent the official position of the National Institutes of Health.

Author information

Authors and Affiliations

Authors

Contributions

Holly Cassell developed the VIRDE program and directs the program, she contributed to the evaluation framework and was a major contributor in writing the manuscript and contributed to data analysis. Elizabeth Rose contributed to the evaluation framework was a major contributor in writing the manuscript and major contributor to data analysis. Troy Moon contributed to the evaluation framework was a major contributor in writing the manuscript. Halima Bello-Manga was a contributor in writing the manuscript. Muktar Aliyu contributed to the evaluation framework was a contributor in writing the manuscript. Wilbroad Mutale contributed to the evaluation framework was a major contributor in writing the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Holly M. Cassell.

Ethics declarations

Ethics approval and consent to participate

All invited participants were emailed a written explanation detailing the purpose of the evaluation survey, including issues of confidentiality, data storage, and who to contact with questions. The invitation stated that participation was voluntary and would not impact their relationship with the host institution or researchers. Thereafter each individual’s decision to either participate in the study or disregard the invitation was taken voluntarily by clicking a survey link that was unique to each invitee. The study protocol and evaluation instrument were approved by the Vanderbilt University Institutional Review Board (#200133) as an “exempt” study, thus formal written consent was not required. The emails and survey links were created using REDCap, which disabled participant identifiers so that researchers were blinded to connecting participant names and responses. All methods were carried out in accordance with relevant guidelines and regulations.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Cassell, H.M., Rose, E.S., Moon, T.D. et al. Strengthening research capacity through an intensive training program for biomedical investigators from low- and middle-income countries: the Vanderbilt Institute for Research Development and Ethics (VIRDE). BMC Med Educ 22, 97 (2022). https://doi.org/10.1186/s12909-022-03162-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12909-022-03162-8

Keywords