Research training needs in Peruvian national TB/HIV programs
© Garcia et al; licensee BioMed Central Ltd. 2010
Received: 7 July 2009
Accepted: 28 September 2010
Published: 28 September 2010
There are few published reports of research training needs assessments and research training programs. In an effort to expand this nascent field of study and to bridge the gap between research and practice, we sought to systematically assess the research training needs of health care professionals working at Peruvian governmental institutions leading HIV and tuberculosis (TB) control and among senior stakeholders in the field.
Six institutional workshops were conducted with the participation of 161 mid-level health professionals from agencies involved in national HIV and TB control. At each workshop informants completed a structured questionnaire and participated in small and large group discussions. Additional data and institutional commitment was obtained through in-depth interviews from 32 senior managers and researchers from the Ministry of Health, academia and NGOs.
Participants exhibited an overwhelming receptivity for additional research training, observing a gap between current levels of research training and their perceived importance. Specialized skills in obtaining funding, developing research protocols, particularly in operational, behavioral and prevention research were considered in greatest need. Beyond research training, participants identified broader social, economic and political factors as influential in infectious disease control.
The needs assessment suggests that future training should focus on operational research techniques, rather than on clinical skill building or program implementation only. Strengthening health systems not only requires additional research training, but also adequate financial resources to implement research findings.
Within the last decade, there has been growing international recognition of the central importance of strong health systems in enhancing health and reducing poverty, coupled with increases in funding to achieve these goals. The Global Forum for Health Research has highlighted the crucial role of research in such efforts to strengthen health systems, both the application of existing research, as well as the need for new research better targeted towards preventable health problems that disproportionately affect billions of people living in low and middle income countries. This dual strategy aims to reduce what the WHO terms the 'know-do gap' so that research findings can be translated into health policy and practice. It also requires health research capacity building and training across disciplines, particularly within countries that experience the highest burdens of disease [1, 2].
Although there is an extensive literature on training health care providers to respond to infectious diseases epidemics, there are comparably fewer published reports of research training needs assessments and research training programs. In his recent review of the literature on medical research training programs, Barton critiques previous accounts for their lack of rigor and infrequent use of mixed methods that are necessary to provide sufficient depth of information to systematically evaluate such programs . Existing research training programs have identified the need for and have employed a range of training modalities from a several hours seminar, to multi-year advanced degree training [3–5]. Nearly all have emphasized the importance of maintaining practitioners' base in the field and in their home country, while simultaneously providing protected work time during which to implement research under supervised mentorship [3, 4, 6, 7]. Goding, Chew and Whitworth identify broader challenges specific to resource-constrained settings, including inadequate funding for health research, poor institutional infrastructure, and lack of appropriate research training, career development pathways and role models opportunities for research scientists .
In an effort to expand the nascent field of study of research training and to bridge the gap between research and practice, we sought to systematically assess the research training needs of Peruvian health care professionals employed predominantly as mid-level managers at public institutions leading HIV and TB diagnosis, prevention, treatment and care in Peru. As background context, Peru is currently experiencing rising incidence of multi-drug resistant tuberculosis (MDR TB), with 6% of the 1,989 confirmed MDR-TB cases reported from 1997 to 2007 classified as extensive drug-resistant tuberculosis (XDR-TB) . Peru's HIV epidemic is concentrated in men who have sex with men, for whom prevalences range from 5.7% in a jungle city to 22.3% in Lima, the country's capital [10–12]. This research training needs assessment coincided with an influx of external resources to address infectious disease epidemics, in particular the Global Fund to Fight AIDS, Tuberculosis and Malaria. The expansion of health care services thus raises additional challenges regarding the scale-up of existing programs and the capacity of the current healthcare workforce to implement them.
With the ultimate aim of improving population-level health, the objectives of this training needs assessment were twofold: to identify the perceived needs by focal area, in relation to existing knowledge levels, and subsequently to prioritize these needs, recognizing the existence of finite resources with which to implement training programs . The impetus for the needs assessment was to inform the development of a tailored training program, which has since been implemented.
From September 2003 to February 2004, we conducted several workshops where we administered structured questionnaires (Additional file 1) and facilitated group discussions to identify and prioritize research training needs among health care professionals working at health centers, hospitals or central offices of three governmental institutions: (1) the Peruvian Ministry of Health, including those whose responsibilities are related to the General Directorate of Epidemiology (DGE), the National STD/HIV/AIDS Control Program (ESNPETSS) and the National TB Control Program (ESNTB); (2) the Peruvian Social Security Health System (ESSALUD), including those from with responsibilities related to the Committee of Tuberculosis Control (TB ESSALUD) and the Committee of HIV/AIDS Control (HIV ESSALUD); (3) the Peruvian Armed Forces Health system, including those related to the HIV/AIDS Control and Prevention Program (COPRECOS) and those related to TB control (TB-FFAA). Together, these institutions represent the major public entities responsible for developing, coordinating and implementing the Peruvian government's public health strategies for TB and HIV control, and for conducting ongoing surveillance of these diseases. All needs assessment activities were conducted in Lima.
Participants were purposively selected from among staff in managerial or coordination roles, who were currently working directly on TB or HIV and who had worked in infectious disease control for at least one year. While responsible for running or coordinating activities related to HIV or TB control, these mid-level managers also had clinical responsibilities and treated patients as part of their routine activities at individual health centers and hospitals.
Key informant interviews
Prior to conducting these institutional workshops, we first conducted key informant interviews with 32 senior stakeholders who had been working in the fields of TB and HIV for ten years or more.
In-depth interviews lasted approximately thirty to forty-five minutes each. Interviewees responded to seven open-ended questions that explored the principle challenges facing Peru regarding TB and HIV, potential solutions, principles of research, priorities for training in research and program management, and appropriate training modalities. These informants provided advice on how best to structure and who to involve in the institutional workshops, specifically recommending that we target mid-level managers who could provide dual clinical and managerial perspectives. In addition to providing these suggestions, these in-depth interviews also helped to engage key actors, who later facilitated access to their staff and whose buy-in is critical to the institutionalization of ongoing training programs.
We designed structured questionnaires with both open- and closed-ended questions based on discussions with key informants and a related literature search. The survey covered demographic characteristics, perceptions of barriers and facilitating factors in receiving training, and asked respondents to rank from 0 to 5 a) current level of training in Peru and b) importance of 51 different training topics covering nine broad themes: fundamentals of research, topics in epidemiology and biostatistics, specific topics related to HIV and TB research, behavior change intervention research, ethics, financing, publication, leadership, and planning, program implementation, monitoring and evaluation. We validated the questionnaire with 18 of our key informants.
We next conducted six one day workshops with participants from health centers, hospitals, institutes and central offices working for the DGE, ESNPETSS, ESNTB, HIV ESSALUD, TB ESSALUD, COPRECOS and TB-FFAA. Participants first completed the structured questionnaire, after which the study team provided an overview of the needs assessment process. An official from the institution gave a formal presentation of the institution's current work in TB and/or HIV. In the afternoon, participants were divided into two groups HIV-related and TB-related, and then into small working groups, each tasked with responding to the open-ended questions, identical to those asked in the key informant interviews. The day concluded with a plenary session in which each small group shared their responses and the larger group was able to engage in discussions.
Demographic data and rankings from the structured questionnaire were analyzed using SPSS 11.0 (Chicago, IL). We conducted content analysis of responses to the open-ended questions to identify prominent topical themes.
Human subjects considerations
The needs assessment proposal was granted a certificate of exemption from the Institutional Review Board at Universidad Peruana Cayetano Heredia.
Results presented here represent responses to close and open-ended questions in the questionnaire, using qualitative responses from small and large group discussions and from key informant interviews to help clarify and contextualize the questionnaire responses.
Characteristics of workshops' participants (N = 161)
> 45 years
Other (psychologist, dentist, biologist, other)
Key informants included the directors of DGE and ESNTB, chiefs of infectious diseases at several large hospitals, professors of medicine and epidemiology at Universidad Nacional Mayor de San Marcos and Universidad Peruana Cayetano Heredia, as well as directors of three non-governmental organizations (NGOs) involved in TB and HIV research and care. Forty one percent (13/32) reported previous involvement in research, less than half (6/13) of whom had authored at least one published research article.
Receptivity to research training
Overall, there was wide acceptance of the importance of institutional capacity building and eagerness to take part in research training, with only 2 of 193 (1%) respondents indicating they would not be willing to take part in future training activities. Participants were in favor of a range of training options, demonstrating preferences for short (workshops or seminars) and medium (semester-long) training options compared to long-term (formal degree) training.
These health care professionals observed a gap between current levels of training, which ranged from medium to little knowledge about specific training topics, and the importance of these areas. Notably, all of the 51 training topics listed in the structured questionnaire were rated as important or very important, underscoring the enthusiasm for research training observed above. There was remarkable consistency in rankings between health care professionals working in TB and those in HIV, and between key informants and institutional participants, indicating that perceptions of training needs were neither disease-specific, nor dependent on the participants' status within the organization.
Perceived training needs among Peruvian TB & HIV health care professionals
Current training level
Importance of training on
Principles of infectious disease
Principles of biosafety
Perinatal transmission of HIV
Prevention research, behavioral research
Principles of biosafety
Program evaluation/operations research
Global epidemiology of HIV/TB
Strategies to identify and apply for research funding, grant writing
Principles of neumology
Protocol development, epidemiological design
Effective communication among investigators and national policymakers
Principles of immunology
Prevention research/behavioral theories
Principles of bacterial pathogenesis
Strategies to identify and apply for research funding
Principles of viral pathogenesis
Principles of health economics
Immunology of HIV
In addition to the list of 51 training topics presented in the questionnaire, respondents identified 175 unique research topics they considered important for future training, including multidrug resistant TB and anti-retroviral medications (regarding new drugs, costs, compliance, implementation of guidelines), and TB/HIV interactions. Analysis of responses to open-ended questions yielded similar results to the close-ended responses, with how to get funding and study design ranking among the highest importance.
Barriers to engagement in research
In small and large group discussions, participants remarked on the paucity of research data on the national level that could be used to develop effective disease control program priorities. There was broad consensus that there exist few opportunities for research training for government health personnel within the current institutional structure, particularly in operational and health services research. These health care professionals cited time and money as primary barriers to their participation in research training activities, noting that their involvement was dependent on personal initiative and self-financing. They further commented on a lack of experience in implementing policies based on research findings, lack of research mentoring, and lack of opportunities for multidisciplinary research collaboration.
Strengthening health systems and operational research
Qualitative responses from mid-level managers regarding research priorities in Peru
On the importance of research
"We need to convince high level authorities about the need to do research, good practical research to improve our services."
"We have to be trained to be able to talk to and convince our authorities [to undertake research], or we have to train our authorities to change."
"We need to do more evidenced-based public health activities. Research can provide us this evidence."
On the need for operations research
"I think that at this point what our country needs is - rather than general research or clinical research on individuals - research on how our health system works; that is, how it operates... operations research and how to help improve it..."
"We need more operations research, something that has been done by NGOs and international donor agencies, but it has been restricted to a few people who know how to do it and they don't even share the results. All health workers should know how to do it and should use operations research as a tool to improve their services."
"We have to learn how to develop research in teams, as part of our day-to-day work. This could become a permanent system to improve."
"I think that a priority is to learn basic epidemiology, but a much higher priority is to learn economics - cost effectiveness it is called, right? And how health systems work and can be improved."
"We should start teaching people about research methods and operations research, health services research, something that will be practical and useful."
Broader socio-political and economical context affecting program results and research
In addition to responses to specific research topics, the key informant interviews and small group discussions highlighted broader socio-economic factors that affect TB and HIV diagnosis: poverty and a culture of silence surrounding HIV and TB and human rights concerns, particularly among vulnerable populations. Participants also discussed political and management issues, such as the weakening of the national TB and HIV programs both financially and politically in recent years, inconsistent political support due to frequent turnover of senior leadership, a lack of coordinated policies among entities engaged in infectious disease control, including between the public and private sectors, and weak ties with the broader community.
Discussion & Conclusions
This research training needs assessment among mid-level health care professionals with dual managerial and clinical roles, and key informant interviews with senior leaders in the field demonstrates that there is a shared perception of the need for training in TB and HIV research and an overwhelming receptivity to take part in future training activities. The results suggest that training topics should focus less on clinical knowledge and more on specific research skills, such as protocol development and operational research design aimed at prevention and treatment. These findings support Dayrit et al's call for more operational and context-specific research conducted at a local country level under the umbrella of a national strategy of health research . Barriers to research training identified by our respondents were consistent with other reports [3, 6, 7], highlighting the need for both supplemental sources of funding from external entities, as well as internal program changes to enable protected work time on research activities.
The satisfaction with clinical training expressed by our participants may in large part reflect the educational background of these health care professionals, who were disproportionately trained in medicine and nursing. This clinical training is focused on skill building and service delivery: diagnosing disease and treating patients. What appears to be lacking for mid-level managers are the antecedents, how to design research studies and public health interventions and obtain resources to fund them, and the assessment of current health care practices in the field. These findings are consistent with previous research training needs assessments that have reported gaps in experience at these two ends of the research spectrum [5, 7]. Many of the participants working in the Ministry of Health National Strategy Programs for TB and HIV and our key informants could be considered policymakers, in that they are the ones developing national standards and regulations for TB and HIV prevention and treatment; however, in each of these groups, insufficient political support was cited as a barrier to effective infectious disease control.
Recognizing that the core function of these institutions is to provide health care services, resources may be best allocated toward providing background training in operational research methods and then creating links between these institutions and research scientists at universities and NGOs so these groups can jointly develop rigorous but feasible research studies, relevant to current issues in the field. Tailored research training would enable government providers to identify research questions and better understand how data can best be collected, but it may be outside the scope of their positions to undertake large research projects. For mid-level managers who are able to integrate research into their program portfolio, structured mentoring relationships with more experienced research scientists appears to be critical to sustained research engagement. In addition to the need for collaboration across institutions, research activities may be enhanced by creating more multidisciplinary teams that include biostatisticians, communications specialists, policy analysts and health economists to complement the predominance of medical expertise.
Although this needs assessment was centered on research training as one mechanism to improve infectious disease control in Peru, several of the themes raised in the open-ended responses suggest that the impact of expanded training opportunities may be context dependent. That is, health system improvements cannot rely on increased knowledge and technical skills alone; they also require ongoing political commitment, adequate financial resources, respect for human rights and poverty reduction efforts. In this sense, our needs assessment was both definitive and exploratory, in that it prioritized specific topics for future training, but also uncovered issues for which there is no easily implementable solution .
These findings largely reflect the perceptions of mid-level and senior managers working within the six national institutions that participated in the research training needs assessment. Since participants were nominated by the institutions themselves, this sample may be biased towards those with a greater affinity towards research or who may be more receptive to training. Participants from Lima were disproportionately represented, though the work of many of these health care professionals is national in scope, and those that work at health centers and hospitals in Lima serve one third of the Peruvian population that resides in the capitol city, where TB and HIV prevalences are much higher than national averages. These results do not reflect perceived needs of health care personnel engaged in private practice.
The way in which the needs assessment was conducted, through participatory workshops, served to foster deeper dialogue and reflection about the role of research within leading government institutions. However, engaging in group discussions may have tempered individual responses, which underscores the importance of triangulating data from self-administered questionnaires, individual interviews with key informants and small and large group discussions.
This research training needs assessment has already proved useful within Peru in guiding future training efforts and research activities for mid-level professionals. On a broader level, it offers insights that may be applicable to other national infectious disease control programs, in terms of the perceived gaps in research training, need for a more multidisciplinary approach, and consideration of contextual factors. These activities offered an initial opportunity to bridge the siloed spheres of academic research scientists and program manager-practitioners, for just as these two diseases gain strength through their interaction, so too must those engaged in their control.
The authors would like to acknowledge the dedicated health care professionals who participated in this needs assessment, and in particular, Dr. José Sebastián Mesones, coordinator of the National Health Strategy for Sexually Transmitted Infections and HIV/AIDS (ESNPETSS); Dr. Roberto Canales La Rosa, former coordinator of the National Health Strategy for Tuberculosis Control (ESNPCT); Dr. Luis Suárez Ognio, director of the General Directorate of Epidemiology (DGE); Dr. Fernando Mendo Urbina, coordinator of the National Committee for HIV/AIDS Control of the Peruvian Social Security System; Dr. Adalberto Max Agüero, former coordinator of the National Committee of HIV/AIDS Control of the Peruvian Social Security System; and Dr. Juan Alva Lescano, of the National HIV/AIDS Control and Prevention Program of the Peruvian Armed Forces (FFAA).
Sources of support
Development Comprehensive ICOHRTA-AIDS/TB (NIH Planning Grant #R21TW006114) and Peruvian ICOHRTA Network for AIDS/TB Research (NIH Training Grant #1U2RTW007374).
- Lansang MAD, Dennis RJ, (Eds): The need to develop research capacity. 2007, London: Pro-Book Publishing Ltd., 123-127.Google Scholar
- Knobler S, Mahmoud AAF, Lemon SM, Forum on Microbial Threats., Institute of Medicine (U.S.), Board on Global Health: The impact of globalization on infectious disease emergence and control: exploring the consequences and opportunities: workshop summary. 2006, Washington, DC: National Academies PressGoogle Scholar
- Barton JR: Academic training schemes reviewed: implications for the future development of our researchers and educators. Medical education. 2008, 42 (2): 164-169. 10.1111/j.1365-2923.2007.02978.x.View ArticleGoogle Scholar
- Hakansson A, Henriksson K, Isacsson A: Research methods courses for GPs: ten years' experience in southern Sweden. Br J Gen Pract. 2000, 50 (459): 811-812.Google Scholar
- Ried K, Farmer EA, Weston KM: Setting directions for capacity building in primary health care: a survey of a research network. BMC family practice. 2006, 7: 8-10.1186/1471-2296-7-8.View ArticleGoogle Scholar
- Paiva V, Ayres JR, Buchalla CM, Hearst N: Building partnerships to respond to HIV/AIDS: non-governmental organizations and universities. AIDS (London, England). 2002, 16 (Suppl 3): S76-82.View ArticleGoogle Scholar
- Jo C, Bacigalupo R, Halladay L, Norwood H: Research use and support needs, and research activity in social care: a cross-sectional survey in two councils with social services responsibilities in the UK. Health & social care in the community. 2008, 16 (5): 538-547.View ArticleGoogle Scholar
- Goding G, Chew M, Whitworth J, (Eds): Capacity strengthening for global health research. 2007, London: Pro-Book Publishing Ltd., 137-139.Google Scholar
- Bonilla CA, Crossa A, Jave HO, Mitnick CD, Jamanca RB, Herrera C, Asencios L, Mendoza A, Bayona J, Zignol M, et al: Management of extensively drug-resistant tuberculosis in Peru: cure is possible. PLoS ONE. 2008, 3 (8): e2957.Google Scholar
- Sanchez J, Lama JR, Kusunoki L, Manrique H, Goicochea P, Lucchetti A, Rouillon M, Pun M, Suarez L, Montano S, et al: HIV-1, sexually transmitted infections, and sexual behavior trends among men who have sex with men in Lima, Peru. Journal of acquired immune deficiency syndromes (1999). 2007, 44 (5): 578-585. 10.1097/QAI.0b013e318033ff82.View ArticleGoogle Scholar
- Lama JR, Sanchez J, Suarez L, Caballero P, Laguna A, Sanchez JL, Whittington WL, Celum C, Grant RM: Linking HIV and antiretroviral drug resistance surveillance in Peru: a model for a third-generation HIV sentinel surveillance. Journal of acquired immune deficiency syndromes (1999). 2006, 42 (4): 501-505. 10.1097/01.qai.0000221677.29693.dd.View ArticleGoogle Scholar
- Ministry-of-Health: Analisis de la Situacion Epidemiologica del VIH/SIDA en el Peru-Bases Epidemiologicas para la Prevencion y Control. Serie Analisis de la Situacion y Tendencias N19. Edited by: Health Mo. 2006, Lima Direccion General de Epidemiologia, --- Either first page or author must be supplied..Google Scholar
- Stevens A, Gillam S: Needs assessment: from theory to practice. BMJ (Clinical research ed. 1998, 316 (7142): 1448-1452.View ArticleGoogle Scholar
- Dayrit MM, Poz MRD, Mercer H, Dolea C, (Eds): Towards evidence-informed policy-making in human resources for health: the state of research. 2007, London: Pro-Books Publishing Ltd., 160-162.Google Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6920/10/63/prepub