Skip to main content

Training needs assessment: tool utilization and global impact

Abstract

Background

Global demand for standardized assessment of training needs and evaluation of professional continuing education programs across the healthcare workforce has led to various instrumentation efforts. The Hennessy-Hicks Training Needs Analysis (TNA) questionnaire is one of the most widely used validated tools. Endorsed by the World Health Organization, the tool informs the creation of tailored training to meet professional development needs. The purpose of this project was to describe TNA tool utilization across the globe and critically appraise the evidence of its impact in continuous professional development across disciplines and settings.

Methods

A systematic integrative literature review of the state of the evidence across PubMed, Scopus, CINAHL, and Google Scholar databases was carried out. Full-text, peer reviewed articles and published dissertations/theses in English language that utilized the original, adapted or translated version of the TNA tool were included. Selected articles were appraised for type and level of evidence.

Results

A total of 33 articles were synthesized using an inductive thematic approach, which revealed three overarching themes: individual, team/interprofessional, and organizational level training needs. Included articles represented 18 countries, with more than two thirds involving high-income countries, and one third middle-income countries. Four studies (12.1%) used the original English version instrument, 23 (69.7%) adapted the original version, and 6 (18.2%) translated and culturally adapted the tool. Twenty-three studies targeted needs at the individual level and utilized TNA to determine job roles and responsibilities. Thirteen articles represented the team/interprofessional theme, applying the TNA tool to compare training needs and perceptions among professional groups. Last, three articles used the tool to monitor the quality of care across an institution or healthcare system, demonstrating the organizational training needs theme.

Conclusions

Overall evidence shows that the TNA survey is widely used as a clinical practice and educational quality improvement tool across continents. Translation, cultural adaptation, and psychometric testing within a variety of settings, populations, and countries consistently reveals training gaps and outcomes of targeted continuous professional development. Furthermore, it facilitates prioritization and allocation of limited educational resources based on the identified training needs. The TNA tool effectively addresses the “know-do” gap in global human resources for health by translating knowledge into action.

Peer Review reports

Background

Over the last 25 years, a trained workforce has been at the core of success for any organization or industry. Appropriate and systematic approaches to training have been shown to result in skills improvement, which in turn raise the quality of employees [1]. Assessing and understanding workforce training needs ensures confidence, know-how, and a variety of new skills that bolster preparedness on an individual and team-based level in any organization [2]. Given the rapid technological advances, persisting workforce shortages, increased disease burden, and shrinking resources, healthcare organizations must methodically survey existing and expected performance levels of their staff [3]. Yet, evaluation of training and development processes, used until the mid-90’s, showed that healthcare professionals were not acquiring the necessary skills to successfully perform their jobs [4]. Similarly, healthcare organizations often did not carry out adequate assessments of training needs, due to limited time and resources, or failure to use research evidence to inform practice [5]. Consequently, training needs analysis (TNA) must be viewed and carried out in the context of existing healthcare systems to be consistent with the needs of employees and relevant to the ever-changing demands of organizations [6].

Literature on healthcare employee training needs has evolved considerably. Several TNA models were developed to understand and address training deficiencies in the workplace through data collection and analysis from both employees and employers [7]. The traditional model focuses on job behavior and task analysis, using surveys and formal interviews to gather data [8]. Its main drawback, besides being time-consuming, is its focus on predetermined outcomes which precludes the possibility of unplanned learning taking place. As an alternative, the practical model considers a trainer-centered, demand-led or supply-led “pedagogical approach” to TNA [9]. Whilst this model helps the TNA coordinator select the appropriate approach for the desired outcome, it does not provide any guidance as to how to conduct an assessment that is both comprehensive and effective. As a result, this approach could be a waste of time and resources.

Acknowledging the above challenges and limitations, investigators from the United Kingdom (UK) in 1996 initiated efforts towards a cost-effective and psychometrically sound TNA tool for the healthcare industry. The Hennessy-Hicks Training Needs Analysis (TNA) Questionnaire, referred as “TNA” from here on after, was developed to identify individual training needs, organizational requirements, and targeted training strategies [10, 11]. Since its development, the TNA tool has been psychometrically tested and used for a variety of purposes among several settings and populations. It has a proven track record for use with primary healthcare teams, district and practice nurses, nurse practitioners (NPs), and health visitors in the UK [10,11,12,13]. The TNA has been shown to minimize response bias and provide reliable information about current performance levels, skill areas most in need of further development, and how to best achieve optimal results. This knowledge facilitates organizations with priority-setting and policy development, as well as with evaluation of their continuous professional development (CPD) programs.

In 2011, the TNA developers licensed the tool to the World Health Organization (WHO) for online use and dissemination through the Workforce Alliance website [14]. With rising calls for evaluating training and competency to regulate nursing practice in the Americas [15], stemming from the “Global strategy on human resources for health: Workforce 2030” [16], our motivation for this project was twofold. First, the lead investigator’s experience with translating, adapting, and applying the TNA instrument in another language, as part of an action research PhD dissertation. Second, the team’s affiliation with a WHO Collaborating Center (WHOCC) that promotes global capacity building for nurses and midwives as well as educational quality improvement (QI). Therefore, this integrative review aimed to describe TNA tool utilization across the globe and critically appraise the evidence of its impact in CPD across disciplines and settings.

Methods

The Hennessy-Hicks TNA Questionnaire and Manual [14] was accessed through the WHO Workforce Alliance website and was carefully reviewed to determine initial intended use. The tool consists of a one-page demographics section, an open-ended question, and a 30-item questionnaire which covers core clinical tasks, arranged into five sub-sections; research/audit, administrative/ technical, communication/teamwork, management/supervisory, and clinical activities. Respondents rate each item on a seven-point scale according to two criteria: “How critical the task is to the successful performance of the respondent’s job” and “How well the respondent is currently performing the task.” Ratings for criterion A (Criticality Index) provide an overall occupational profile of the job, and those for criterion B (Skill Index) the level of performance. Subtracting the scores (criterion A – criterion B) in each task provides a Training Needs Index. The accompanying manual offers instructions, data analysis, and customization for use in one’s own environment.

To allow for cross-country and cross-setting comparisons, the investigators adopted the Knowledge to Action (KTA) Framework developed by Graham et al. [17]. Knowledge translation is “a dynamic and iterative process that includes the synthesis, dissemination, exchange and ethically sound application of knowledge” [18]. The KTA process conceptualizes the relationship between knowledge creation and action as a “funnel”. Knowledge is increasingly distilled before it is ready for application whereas, the action cycle represents the activities needed for knowledge application and integration [17]. By translating knowledge into action, researchers can effectively address the “know-do” gap in healthcare practice [19].

Search strategy – eligibility criteria

The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines were adhered to in the conduct and reporting of this systematic integrative review [20]. An electronic database search in PubMed, Scopus, CINAHL, and Google Scholar was performed using the following strategy: ((“Surveys and Questionnaires”[Mesh] OR tool* OR measure* OR questionnaire* OR survey* OR scale* OR instrument*) AND (Hennessy OR Hicks OR Hennessy-Hicks OR “Hennessy-Hicks Training Needs Assessment Questionnaire”) AND (nurs* OR training-needs)).” All full-text, peer reviewed articles, dissertations or theses published in English language since 1996 were included. Additionally, a targeted manual search of grey literature and listed references was carried out. A total of 289 articles were retrieved and duplicates were removed with the use of Sciwheel Reference Manager. The resulting 265 articles were first screened by title/abstract, and then, 97 full-text articles were assessed for eligibility. During screening and eligibility steps, inclusion was determined if any of the following content-specific criteria were met: a) study using the original TNA tool, b) psychometrics study carrying out translation and/or cultural adaptation of the TNA tool in other languages or countries, and c) study applying or integrating an adapted TNA version. The above search strategy, along with reasons for excluding articles, is depicted in Fig. 1.

Fig. 1
figure 1

PRISMA Search Strategy for TNA Tool

Data extraction and quality appraisal

Initial title and abstract screening was conducted by an independent investigator (SM), with full-text article assessment for eligibility and data extraction carried out by two independent investigators (SM, LT). Any conflicting votes on eligibility of an article were resolved by a third investigator (AM). Appraisal of level of evidence was based on the adapted Rating System for the Hierarchy of Evidence [21, 22]. The World Bank Atlas was followed for country classification by income level (high, middle or low) [23]. An inductive thematic analysis of the literature sample was carried out. Interprofessional education (IPE) and collaborative practice were operationalized based on the Framework for Action on Interprofessional Education and Collaboration, developed by WHO [24]. Hence, both terms ‘interdisciplinary’ and ‘multidisciplinary’, often used interchangeably, were captured. Given the systematic review methodology of this study, no study approval was required.

Results

A total of 33 articles, published within the last 25 years (January 1996–May 2020), met our inclusion criteria and are presented in Table 1. A summary of their characteristics and appraised evidence is shown in Table 2. The majority of the articles (87.9%) were original research, 9.1% were dissertations or theses, and 3% posters. Thirty-two (97%) of the studies were descriptive or mixed methods (level VI evidence), and one (3%) was an expert opinion (level VIII). Study populations included nurses (72.7%), physicians (12.1%), other healthcare professionals (30%), and health insurance employees (3%). Settings ranged from primary healthcare (57.6%), to acute care (51.5%), and other organizations (6.1%) or companies (3%). As shown in Table 3, a total of 18 countries were represented, with the majority originating from the UK. More than two thirds (69%) focused on high-income countries (HIC), 28% on middle-income countries (MIC), and only 3% on low-income countries (LIC).

Table 1 Characteristics of studies using the Hennessy-Hicks TNA tool (n = 33)
Table 2 Summary of characteristics and evidence appraisal (n = 33)
Table 3 Classification of TNA use by country income level and theme

In terms of TNA tool use, 4 (12.1%) studies used the original English version instrument, 23 (69.7%) adapted the English version, and 6 (18.2%) translated and culturally adapted the tool. Translation and cultural adaptation of the original TNA was carried out in the following languages/countries: a) Bahasa Indonesian - tested among community nurses and midwives in Indonesia [31,32,33]; b) Greek - tested among rural primary care nurses, midwives, and health visitors in Greece [45, 46]. In addition, a modified version of TNA was translated and culturally adapted into the following languages/countries: a) Kiswahili – tested among reproductive, maternal, and newborn healthcare workers in Mwanza, Tanzania [48]; b) Bulgarian, Polish, Italian, Albanian, and Romanian – tested among formal and informal caregivers across European Union countries and immigrant communities [50]. Furthermore, a thematic analysis revealed the following three levels in training needs analysis: a) individual level; b) interprofessional or team/unit level; and c) organizational level.

Individual training needs analysis

As listed in Table 1, a total of 17 studies centered on identifying or targeting needs at the individual level within a specific population of interest across a variety of settings [8, 12, 13, 25, 30, 32, 33, 37,38,39, 41,42,43,44, 49, 50, 53]. Nurses, physicians, midwives, and other healthcare professionals were studied in primary healthcare, acute care, healthcare organizations, and other businesses. All 17 articles applied the TNA tool to determine specific job roles and responsibilities within the targeted setting. Hence, an individual’s perceptions about which tasks were most important for performing their jobs were assessed and captured in column A of the TNA tool. For example, Hicks and Tyler [38] used the tool to determine the required education for family planning nurses in the UK, analyzing the tasks these nurses performed, while also allowing them to indicate their training needs. By comparing the roles of the family planning nurse with the family planning nurse prescriber, the investigators determined the nuances that distinguished the two roles in two consecutive studies [38, 53].

Eight articles determined job profile differences in a variety of geographical locations [12, 13, 30, 32, 33, 38, 50, 53]. Four of these articles compared training needs across different countries or regions; within the UK, USA, and Australia [30], across Indonesia [32, 33], and across five European countries [50]. For example, Pavlidis et al. [50] determined the differences in caregivers’ perceived training needs across the UK, Greece, Bulgaria, Poland, and Italy. Four main training needs were reported as contributing to quality care improvement: a) basic nursing skills; b) specialization in specific conditions (such as diabetes, stroke, dementia); c) training in advanced health care systems; and d) training in psychology-related skills, such as time management, emotion regulation, and communication [50]. Targeting those skills was deemed to improve European caregivers’ capacity in the health and social services sectors.

Existing knowledge gaps, and the most effective training methods to meet individual training needs, were identified across all articles. For example, a study carried out in Ireland, determined medical doctors’ training needs to inform professional development courses [43]. Workload/time organization and stress management were identified as the most pressing needs, while doctor-patient communication was ranked highest for importance and level of current performance. The TNA tool allowed for setting priorities that best met individuals’ training needs, and facilitated managers, local governments to allocate scarce budgets and resources to improve the quality of health care [43]. Similarly, a dissertation study of South African managers in public hospitals revealed that a combination of formal and informal training, enhanced by qualitative research, was the best strategy [49].

Team/Interprofessional training needs analysis

A total of 13 articles exhibited the team/IP training needs theme, encompassing more than one professional group or focusing on a team or unit as a whole [26, 28, 29, 31, 34, 35, 40, 45, 46, 48, 51, 52, 54]. Target populations included nurses, physicians, and other healthcare professionals across acute and primary care, as well as healthcare institutions. Twelve of the articles were descriptive, qualitative, or mixed methods studies (level VI evidence) whereas, one was an opinion article (level VIII evidence) [34].

Articles under this theme utilized the TNA tool for a wide variety of purposes, including to monitor and optimize quality of care. For instance, Singh and colleagues [52] utilized the TNA tool at a tertiary care hospital in India to evaluate nurses’ training needs. They identified patient care, research capacity, managerial/administrative, and communication as the highest priorities [52]. Other investigators used the tool to determine perception of job roles by nurses and their managers. TNA developers, Hicks and Hennessey [35], used the tool to define the newly established NP role in the UK, providing an operational definition and specific training needs to be targeted. The researchers surveyed all nurses working at advanced clinical levels within an acute sector of the National Health System (NHS) trust. Their triangulation results indicated overall consensus between the nurses and their managers, regarding both the definition of the NP role and the essential training requirements, with somewhat differing opinions by the medical staff [35]. Subsequently, implications in regulating educational provision for NPs in the UK emerged.

The TNA tool was also used to compare training needs and perceptions between different professional groups in the clinical setting, thus allowing for greater analysis of job roles and responsibilities. For instance, Markaki et al. [46] used the tool in Greek primary healthcare centers to determine the occupational profile differences between nurse graduates from 2-year programs and graduates from 3- or 4-year programs. Collected data were then used to determine training gaps to be targeted by future interventions. Determination of training needs at all levels allowed for budgetary analysis and resource allocation for optimum results. Hicks and Hennessy focused on improving the capacity of the NHS trust and its employees by identifying the training needs of practice nurses [34]. In this 1997 study, practice nurses considered communication and teamwork to be the most important aspects of their job, and there was overlap in the training needs identified by the nurses themselves and by their managers. In 2005, Hicks and Thomas [40] analyzed the training needs among professionals delivering community sexual health services and used the data to recommend additional courses within the allocated budget. Similarly, Mwansisya et al. [48] surveyed reproductive, maternal and neonatal healthcare workers within eight districts in Tanzania and provided a baseline of training needs in a low middle-income country. Another study, carried out at a School of Dentistry in a Sudanese university, showed that faculty and staff prioritized academic student supervision, data analysis, and effective presentation skills [54]. The survey also revealed knowledge deficits related to legislation and community engagement. The investigators concluded that effective targeting of these group training needs would require development of university-wide policies for training [54].

Organizational training needs analysis

Three articles focused on improving outcomes for an organization, such as a healthcare system, hospital, or business [27, 36, 47]. Targeted populations were nurses, physicians, other healthcare professionals, and business employees. Barratt and Fulop [27] applied the TNA tool to improve use of research, and knowledge generation participation, across healthcare and public health organizations in London and Southeast England. In doing so, the investigators identified key tasks, priorities, and barriers to building research capacity, such as assessing the relevance of research and learning about new developments [27]. An earlier study by Hicks and Hennessey explored the issue of evidence-based clinical care within the context of diminishing resources in the British NHS [36]. A TNA survey from seven NHS trusts showed common training needs and skill deficits in relevance to locality and clinical area. The authors concluded that targeting the real skill deficits of the workforce, as well as the personnel most in need of training, was essential for effective integration of evidence-based care within routine practice [36]. Last, Moty [47] focused on technology improvement at a contract research organization to incorporate user feedback into a portal system through the TNA tool. By incorporating end users’ input to optimize portal design, more positive opinions about portal technology could be solicited, and desire to use technology could be increased [47]. All three articles demonstrated the tool’s versatility in addressing organizational training needs at a systems level through an integrated approach.

Discussion

This integrative review synthesized evidence about TNA tool utilization across the globe, and critically appraised its impact in CPD across various disciplines, settings, and countries. The tool proved to be modifiable for different purposes and contexts, without compromising its high validity and reliability. Its flexible design allowed it to be easily adapted to various populations, settings, and cultures while retaining its psychometric characteristics. Hence, the tool’s value as an international instrument for analyzing training needs in the healthcare and education sectors became evident.

TNA tool utilization across the globe

Following initial development and testing, the TNA instrument was successfully used in the UK to identify individual training needs and trends related to demographics, with an emphasis on development of the NP role at the early stages [12, 13, 30]. Carlisle and colleagues [8] summarized the latent factor structures that affect the occupational profile construct of the TNA scale and examined them within the Australian context. The investigators confirmed the original five-factor model and suggested that the underlying dimensions relating to the occupational profile were perceived to be important for high performance by nurses in Australia [8]. Nevertheless, the majority of studies reflecting individual training needs struggled with low response rates and self-report bias. Therefore, investigators cautioned about conclusions drawn from data that relied on individuals’ own perceptions of their learning needs. At the team/IP level, perception of training gaps and competences among nurses, midwives, physicians, and public health staff in settings ranging from hospitals to rural health facilities emerged throughout 10 countries. Specifically, in Singapore [26], Australia [28], Saint Lucia [29], Indonesia [31], UK [34], Greece [45, 46], Tanzania [48], South Africa [51], India [52], and Sudan [54]. These studies used the TNA tool for primary data collection, with one translation and validation into Bahasa Indonesian language [31] and another into Greek [45]. Training needs of a group of interest were compared to those of other professional groups or team members to tailor CE offerings and optimize IP operations. At the organizational level, UK healthcare institutions and NHS trusts [27, 36] as well as a US contract research organization [47] used the TNA instrument to improve research capacity/utilization, identify key barriers, and mitigate resistance to change. By establishing the relationship between organizational factors (hospitals) and demographic variables, individual occupational competency profiles, as well as team professional development, can be planned and executed by HR departments.

Further synthesis of sampled participating countries, depicted in Fig. 2, revealed that two-thirds of the studies occurred in HICs and one-third in MICs, with only one study stemming from an LIC. Out of 11 studies that used translated TNA versions, three were from Indonesia (MIC), two from Greece (HIC), and one study involved six European countries (4 HICs, 2 MICs). Cross-country comparison by income classification and TNA theme allowed for examination of challenges or limitations in usage of the original, adapted, or translated TNA tool version, and how these were addressed by the investigators. According to Gaspard and Yang [29], how a healthcare professional determines which tasks are essential, and how they perceive their actual performance of that task, may be influenced by several factors. For instance, motivation for continuous learning, a special interest in a particular task, a specific education deficit, and satisfaction or not with unit management. This limitation is addressed by allowing for two ranking systems - where employers also rank employees - to cross-check motivation and establish the need. For example, to determine NP training that would satisfy NHS trust aims, a full training needs analysis of nurses and their immediate supervisors was carried out [34]. The nurses completed the analysis with their own perceptions of training needs, while their managers completed it on behalf of the identified nurse. The resulting mutually agreed training program enhanced understanding of both parties’ agendas and could be achieved with minimum conflict [8, 33, 34, 46]. For Greek nurses in rural PHC settings, appropriate training activities, along with organizational changes, had potentially equal impact on short-term staff development and long-term strategic planning programs [46].

Fig. 2
figure 2

Literature heat map – TNA tool use by country income level. *Income country classification by World Bank [23]

Reported flaws or limitations of the original or adapted/translated TNA tool included: a) small-scale study [8, 26, 37, 40, 42, 45, 46]; b) polling only one organization, or specific unit [26, 29, 37, 42, 49]; c) not surveying employers or stakeholders [28, 29, 48, 51]; d) low participation or item completion rates [34, 38, 45, 46, 53]; e) lack of consensus at a national level regarding training content [45]; and f) focus on individual and team assessment, rather than organizational [25, 39]. Last, one study included only 10 out of the 30 original TNA items, with the rest of items being newly introduced [50], which exceeds the developers’ threshold for psychometrics modification [14]. Furthermore, some investigators recommended further studies to explore TNA’s: a) applicability in a wider healthcare system, b) feasibility as a large-scale survey instrument in secondary and tertiary care settings, and c) usability for collaborative activities, especially through global information technology network teaching programs [34, 45, 48].

The main advantage of the TNA instrument is the accompanying detailed instruction manual, made available by the developers through the WHO Workforce Alliance website [14]. According to this manual, the standard 30-item questionnaire can be tailored to a particular study focus. Up to 8 of the original items can be changed or omitted, and up to 10 new items can be added. To this direction, the developers have included an example of how to adjust the questionnaire ([14], p.21-25). The additional items are to be devised according to an accepted psychometric process for developing questionnaires. For example, a literature review, focus group and interview with relevant personnel should be conducted, with the information distilled into themes, using an approved data-reduction method, such as the Thematic Network Analysis [55]. This provides the core areas from which tailored items are to be constructed. Coverage of the themes (and subsequent items) should be comprehensive and appropriate. These themes will form the basis for new items, which should be in a format similar to that of the standard questionnaire. Modified questionnaires should be piloted with a small sample. The manual includes additional item banks that have been used in other studies, grouped as follows: “Extended nursing role”, “Nurse prescribing”, “Specialist care”, “Child abuse / child protection”, and “Management” ([14], p.50-55). This item bank allows for easy tailoring to an investigator’s aim and unique context.

Global impact in continuous professional development

Regardless of country and profession surveyed, the tool consistently revealed the perceived and assumed training needs, clarified roles, and facilitated CPD at the individual or team level. Sampled literature revealed that there were no universal trends in training needs according to locus of practice, and that training requirements were specific to the actual role performed within an organizational environment. For example, Hicks & Tyler [38] and Hicks & Fide [39] demonstrated that a more targeted, less costly, training program would be optimum, upon surveying the roles and training needs of family planning nurses and breast care nurses in the UK. Organizational factors were shown to determine the occupational profile and training needs of nurses in primary and secondary care across Australia, UK, and the USA [8, 30, 36]. Similarly, most surveyed caregivers in five European countries declared a need for training in the psychosocial aspects of caregiving [50]. Yet, when dealing with stress, caregivers from Italy and Greece had lower needs than those from Poland, UK, and Turkey. Despite the socio-economic differences among countries, all participants faced increasing demands from caregiver burden [50]. For employees in the Nigerian health insurance industry, addressing the gaps through an on-the-job training course was deemed to be the optimum approach [25]. For each country seeking to minimize economic impact and streamline processes, the TNA tool provided an affordable, standardized approach to prioritize and implement an effective CPD program.

Several other studies concurred on the urgent need for flexible and tailored CPD, as an outcome of a comprehensive TNA analysis [26, 33, 40, 44, 46, 52,53,54]. Especially in middle-income and low-income countries, such as Saint Lucia, South Africa and Sudan, strengthening university-level education for nurses and other healthcare professionals was a key recommendation for evidence-based decision making [29, 51, 54]. In the case of Indonesia, the introduction of TNA in a series of studies, carried out by Hennessy and colleagues [31,32,33], motivated several junior nurse researchers to pursue and study CPD, as reflected in multiple references of the instrument. Given the prevailing budget constraints and limited accessibility to research funds, it was not surprising that training needs in research competences emerged as top priorities across studies conducted in MICs and LICs. In Turkey, building research capacity among public health professionals to tackle prevailing non-communicable diseases, was seen as a national priority [42]. Following identification of several individual, team and organizational barriers, a comprehensive CPD plan for junior researchers, and a QI plan for governmental institutions were recommended. This latter plan provides a roadmap for addressing the lack of coordination between institutions and researchers, establishing research monitoring and evaluation, and strengthening routine health information systems. Similarly, in Sudan, the top QI priority for university faculty of Dentistry was research, followed by leadership, health professions management, community engagement, and teaching skills [54]. As demonstrated in a UK study, raising the ability of NHS organizations to use research and generate knowledge was tied to improved services and population health [27]. The above findings support the argument for research capacity as an essential component of PHC nursing [56]. Moreover, findings show the critical need for operational integration of standardized QI processes across units or institutions in order to close the gap between theory and practice [57]. Hence, implementation of a regionally based CPD and QI program, stemming from TNA application, could be the solution to a healthcare system in need of reform.

Strengths and limitations

Integrative reviews allow for the combination of diverse methodologies (i.e., experimental and non-experimental research) in order to more fully understand a phenomenon of concern [58]. By combining data from the theoretical as well as empirical literature, this review could potentially impact evidence-based practice for nursing and other healthcare professions. The ongoing worldwide interest in the Hennessy-Hicks TNA instrument and manual has been a strong incentive for this review. Following personal communication with the developers, they confirmed receipt of many email enquiries, estimated around 100, from around the world asking for permission or clarification about using the tool and informing about outcomes. Unfortunately, there is no cumulative record of requests during the past 25 years. This lack of usage data and repository was further compounded by inability to obtain webpage metrics (i.e. ‘hits’ and ‘downloads’) due to the hosting Global Health Workforce Alliance (GHWA) webpage no longer being maintained [14]. Therefore, no information was available on who has been using the tool nor who is resourcing the archived tool on the GHWA website.

This review was based on an extensive search of four major electronic databases and a targeted manual search of grey literature and cross-listed references. The selected databases (PubMed, CINAHL, Scopus, and Google Scholar) capture a variety of international journals in the nursing, social sciences, and biomedical literature, with relevant hand-searched theses and dissertations also included. All articles were independently reviewed and appraised, using an adapted hierarchy scale for level of evidence [26, 27]. The main limitation stems from the exclusion of any relevant literature published in languages other than English. According to the developers, TNA has been translated into many other languages, including Arabic and Chinese, but there was scarce evidence published in the English literature. Upon appraisal, variation in criteria application, along with cross-country cultural and linguistic variations are also acknowledged. Last, World Bank rankings [23] were based on the 2020 index rather than the year when the study was conducted. Because of the relatively small sample size (n = 33), the investigators combined the “low-middle income countries” with the “upper-middle income countries” categories under “middle-income countries” (MIC).

Implications

The TNA instrument allows for triangulation of a) assessment (identifying and triaging needs); b) needs (gap between what exists and what is required); and c) training (acquiring knowledge, skills or change attitude). Our literature review synthesized the reported use and value of the Hennessey-Hicks TNA tool across settings, populations, and countries, identified the enablers and barriers to its use, and distilled best practice CPD recommendations. Viewed from the KTA Framework perspective, our findings explain how the scholarship of discovery (TNA tool development, psychometrics of adapted or translated versions) leads to the scholarship of integration (translation and cultural adaptation of TNA), and ultimately to scholarship of application (using different versions of the tool across various settings, populations, or countries). As knowledge moves through each stage, it becomes more synthesized and therefore, useful to end-users. Hence, for healthcare professionals, CE should be based on the best available knowledge, the use of effective educational strategies, and the planned action theories to understand and influence change in practice settings [17]. A recent metasynthesis of CPD literature highlights nurses’ belief in CPD, as fundamental to professionalism and lifelong learning, and its importance in improving patient care standards [59]. Yet, it shows a disconnect between nurses’ CPD needs and expectations with the organizations’ approaches to professional development. The authors conclude that access to CPD should be made more attainable, realistic and relevant [59]. By translating TNA evidence into action, health policy makers, administrators, and educators can effectively design appropriate, cost-effective CPD programs with clear priorities to achieve the desirable knowledge, skills and practice, tailored to local needs.

There is also a high level of fit between the adopted KTA Framework and the affiliated WHOCC’s Terms of Reference. Completion of this review coincided with the start of a project by the Registered Nurses Association of Ontario, aiming to develop a repository of measurement tools that can be mapped to the KTA Framework, and to report on their pragmatic and psychometric properties. Given that the TNA measurement tool has been identified as mappable to the KTA framework, the potential synergy between the two groups is promising. Moreover, our findings are aligned with WHO recommendations based on the “Framework for Action on Interprofessional Education and Collaborative Practice” [24]. These call for health policy makers to systematically address training needs of the healthcare workforce in order to strengthen IPE and collaborative practice. As tasked by the Pan American Health Organization (PAHO), the affiliated WHOCC aims to enhance the use and dissemination of knowledge resources that build capacity and leadership for nurse and midwife educators. Hence, lessons learned will be used to promote TNA tool application and integration for individual, team/IPE, and organizational improvement across the PAHO region (North/Central/South America and the Caribbean). These steps are both timely and relevant for evaluating training and competency, and for regulating nursing practice in the Americas [15] during the post-pandemic era.

Conclusion

Since its development in 1996, the TNA instrument has been widely used as a clinical practice and educational quality improvement tool across continents. Translation, cultural adaptation, and psychometric testing within a variety of settings, populations, and countries consistently reveal training gaps along the individual, team/interprofessional, and organizational themes. It is not only applied to identify training needs and demographic trends, but also to prioritize targeted training strategies and CPD programs. Furthermore, it facilitates triaging and allocating limited educational resources, especially in low and middle-income countries. These findings underscore the tool’s effectiveness in addressing the “know-do” gap in global human resources for health by translating knowledge into action.

Availability of data and materials

All data generated or analyzed during this study are included in this published article.

Abbreviations

CE:

Continuing Education

CPD:

Continuous Professional Development

HIC:

High Income Countries

IP:

Interprofessional

IPE:

Inter-Professional Education

KTA:

Knowledge to Action

LIC:

Low Income Countries

MIC:

Middle Income Countries

NHS:

National Health System

NP:

Nurse Practitioner

PHC:

Primary Health Care

QI:

Quality Improvement

PAHO:

Pan American Health Organization

TNA:

Training Needs Analysis

WHO:

World Health Organization

References

  1. Kai Ming Au A, Altman Y, Roussel J. Employee training needs and perceived value of training in the Pearl River Delta of China: a human capital development approach. J Eur Ind Train. 2008;32(1):19–31. https://doi.org/10.1108/03090590810846548.

    Article  Google Scholar 

  2. Bhattacharya M, Wright PM. Managing human assets in an uncertain world: applying real world options theory to HRM. Int J Hum Resour Manag. 2005;16(6):929–48. https://doi.org/10.1080/09585190500120574.

    Article  Google Scholar 

  3. Denby S. The importance of training needs analysis. Ind Commer Train. 2010;42(3):147–50. https://doi.org/10.1108/00197851011038132.

    Article  Google Scholar 

  4. Hennessy DA. Changing health service requires a changing workforce. In: Littlewood J. current issues in community nursing. Edinburgh: Churchill Livingstone; 1995.

    Google Scholar 

  5. Grimshaw JM, Eccles MP, Lavis JN, Hill SJ, Squires JE. Knowledge translation of research findings. Implement Sci. 2012;7(1):50. https://doi.org/10.1186/1748-5908-7-50.

    Article  Google Scholar 

  6. Joly B, Coronado F, Bickford B, Leider J, Alford A, McKeever J, et al. A review of public health training needs assessment approaches: opportunities to move forward. J Public Health Manag Pract. 2018;24(6):571–7. https://doi.org/10.1097/PHH.0000000000000774.

    Article  Google Scholar 

  7. Gould D, Kelly D, White I, Chidgey J. Training needs analysis. A literature review and reappraisal. Int J Nurs Stud. 2004;41(5):471–86. https://doi.org/10.1016/j.ijnurstu.2003.12.003.

    Article  Google Scholar 

  8. Carlisle J, Bhanugopan R, Fish A. Latent factor structures affecting the occupational profile construct of the training needs analysis scale. Int J Hum Resour Man. 2012;23(20):4319–41. https://doi.org/10.1080/09585192.2012.665073.

    Article  Google Scholar 

  9. Chiu W, Thompson D, Mak W, Lo KL. Re-thinking training needs analysis: a proposed framework for literature review. Pers Rev. 1999;28(1/2):77–90. https://doi.org/10.1108/00483489910249009.

    Article  Google Scholar 

  10. Hicks C, Hennessy D, Barwell F. Development of a psychometrically valid training needs analysis instrument for use with primary health care teams. Health Serv Manag Res. 1996;9(4):262–72. https://doi.org/10.1177/095148489600900406.

    Article  Google Scholar 

  11. Hicks C, Hennessy D. Applying psychometric principles to the development of a training needs analysis questionnaire for use with health visitors, district and practice nurses. J Res Nurs. 1996;1(6):442–54. https://doi.org/10.1177/174498719600100608.

    Article  Google Scholar 

  12. Hicks C, Hennessy D. The use of a customized training needs analysis tool for nurse practitioner development. J Adv Nurs. 1997;26(2):389–98. https://doi.org/10.1046/j.1365-2648.1997.1997026389.x.

    Article  Google Scholar 

  13. Hicks C, Hennessy D. A task-based approach to defining the role of the nurse practitioner: the views of UK acute and primary sector nurses. J Adv Nurs. 1999;29(3):666–73. https://doi.org/10.1046/j.1365-2648.1999.00935.x.

    Article  Google Scholar 

  14. Hennessy D, Hicks C. Hennessy-Hicks Training Needs Analysis Questionnaire and Manual. 2011. Available at: https://www.who.int/workforcealliance/knowledge/toolkit/19/en/ Accessed 20 Dec 2020.

    Google Scholar 

  15. Cassiani SHB, Lecorps K, Rojas Cañaveral LK, da Silva FAM, Fitzgerald J. Regulation of nursing practice in the Region of the Americas. Rev Panam Salud Publica. 2020;44:e93. https://doi.org/10.26633/RPSP.2020.93.

    Article  Google Scholar 

  16. World Health Organization. Global strategy on human resources for health: Workforce 2030. http://www.who.int/hrh/resources/pub_globstrathrh-2030/en/. Accessed 20 Dec 2020.

  17. Graham ID, Logan J, Harrison MB, Straus SE, Tetroe J, Caswell W, et al. Lost in knowledge translation: time for a map? J Contin Educ Heal Prof. 2006 Winter;26(1):13–24. https://doi.org/10.1002/chp.47.

    Article  Google Scholar 

  18. Canadian Institutes of Health Research. Knowledge translation. http://www.cihr-irsc.gc.ca/e/29418.html. Accessed 20 Dec 2020.

  19. Straus SE, Tetroe J, Graham ID. Chapter 1.1 Introduction: Knowledge translation: What it is and what it isn’t. In: Straus SE, Tetroe J, Graham ID, editors. Knowledge Translation in Health Care. 2nd ed. Oxford: John Wiley & Sons and BMJ Books; 2013. p. 1–13.

  20. Moher D, Liberati A, Tetzlaff J, Altman DG, The PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: The PRISMA Statement. PLoS Med. 2009;6(7):e1000097. https://doi.org/10.1371/journal.pmed.1000097.

    Article  Google Scholar 

  21. Fineout-Overholt E, Melnyk BM, Stillwell SB, Williamson KM. Critical appraisal of the evidence: part I. AJN. 2010;110(7):47–52. https://doi.org/10.1097/01.NAJ.0000383935.22721.9c.

    Article  Google Scholar 

  22. Dang D, Dearholt S. Johns Hopkins nursing evidence-based practice: model and guidelines. 3rd ed. Indianapolis: Sigma Theta Tau International; 2017.

    Google Scholar 

  23. World Bank. World Bank country and lending groups. https://datahelpdesk.worldbank.org/knowledgebase/articles/906519-world-bank-country-and-lending-groups Accessed 20 Dec 2020.

  24. World Health Organization (WHO). Department of Human Resources for Health. Framework for action on interprofessional education and collaborative practice. 2010. Ref #: WHO/HRH/HPN/10.3 http://www.who.int/hrh/resources/framework_action/en/. Accessed 20 Dec 2020.

    Google Scholar 

  25. Adewole DA, Bello S, Adebowale SA. Preferred approach to performance improvement among stakeholders in the health insurance industry in southwest region of Nigeria: implications for universal health coverage. J Commun Med Prim Health Care. 2019;31(2):78–89.

    Google Scholar 

  26. Aw AT, Drury V. Identification of the educational needs and feasible educational modalities for specialist nurses working with ophthalmic patients in a tertiary eye Centre in Singapore. Proc Singapore Healthc. 2016;25(4):215–21. https://doi.org/10.1177/2010105816647743.

    Article  Google Scholar 

  27. Barratt H, Fulop NJ. Building capacity to use and undertake research in health organisations: a survey of training needs and priorities among staff. BMJ Open. 2016;6(12):e012557. https://doi.org/10.1136/bmjopen-2016-012557.

    Article  Google Scholar 

  28. Eyres C, Lima S. New Hospital, New Training Needs. In: Proceedings of the 29th international nursing research congress: innovative global nursing practice and education through research and evidence-based practice. Melbourne; 2018. https://sigma.nursingrepository.org/handle/10755/624520.

  29. Gaspard J, Yang C-M. Training needs assessment of health care professionals in a developing country: the example of Saint Lucia. BMC Med Educ. 2016;16(1):112–8. https://doi.org/10.1186/s12909-016-0638-9.

    Article  Google Scholar 

  30. Hennessy D, Hicks C. A cross-cultural tool to identify continuing education needs. Int Nurs Rev. 1998;45(4):109–14. https://doi.org/10.1046/j.1466-7657.45.no.4issue340.4.x.

    Article  Google Scholar 

  31. Hennessy D, Hicks C, Hilan A, Kawonal Y. A methodology for assessing the professional development needs of nurses and midwives in Indonesia: paper 1 of 3. Hum Res Health. 2006a;4:8. https://doi.org/10.1186/1478-4491-4-8.

    Article  Google Scholar 

  32. Hennessy D, Hicks C, Koesno H. The training and development needs of midwives in Indonesia: paper 2 of 3. Hum Res Health. 2006b;4:9. https://doi.org/10.1186/1478-4491-4-9.

    Article  Google Scholar 

  33. Hennessy D, Hicks C, Hilan A, Kawonal Y. The training and development needs of nurses in Indonesia: paper 3 of 3. Hum Res Health. 2006c;4:10. https://doi.org/10.1186/1478-4491-4-10.

    Article  Google Scholar 

  34. Hicks C, Hennessy D. Identifying training objectives: the role of negotiation. J Nurs Manag. 1997;5(5):263–5. https://doi.org/10.1046/j.1365-2834.1997.00021.x.

    Article  Google Scholar 

  35. Hicks C, Hennessy D. A triangulation approach to the identification of acute sector nurses' training needs for formal nurse practitioner status. J Adv Nurs. 1998;27(1):117–31. https://doi.org/10.1046/j.1365-2648.1998.00508.x.

    Article  Google Scholar 

  36. Hicks C, Hennessy D. Quality in post-basic nurse education: the need for evidence-based provision. J Nurs Manag. 1999;7(4):215–24. https://doi.org/10.1046/j.1365-2834.1999.00132.x.

    Article  Google Scholar 

  37. Hicks C, Hennessy D. An alternative technique for evaluating the effectiveness of continuing professional development courses for health care professionals: a pilot study with practice nurses. J Nurs Manag. 2001;9(1):39–49. https://doi.org/10.1111/j.1365-2834.2001.00203.x.

    Article  Google Scholar 

  38. Hicks C, Tyler C. Assessing the skills for family planning nurse prescribing: development of a psychometrically sound training needs analysis instrument. J Adv Nurs. 2002;37(6):518–31. https://doi.org/10.1046/j.1365-2648.2002.02127.x.

    Article  Google Scholar 

  39. Hicks C, Fide J. The educational needs of non-specialist breast care nurses. Nurse Educ Today. 2003;23(7):509–21. https://doi.org/10.1016/S0260-6917(03)00075-3.

    Article  Google Scholar 

  40. Hicks C, Thomas G. Assessing the educational needs of community sexual healthcare practitioners. Health Soc Care Commun. 2005;13(4):323–9. https://doi.org/10.1111/j.1365-2524.2005.00561.x.

    Article  Google Scholar 

  41. Holloway K, Arcus K, Orsborn G. Training needs analysis - the essential first step for continuing professional development design. Nurse Educ Pract. 2018;28:7–12. https://doi.org/10.1016/j.nepr.2017.09.001.

    Article  Google Scholar 

  42. Kilic B, Phillimore P, Islek D, Oztoprak D, Korkmaz E, Abu-Rmeileh N, et al. Research capacity and training needs for non-communicable diseases in the public health arena in Turkey. BMC Health Serv Res. 2014;14(1):373. https://doi.org/10.1186/1472-6963-14-373.

    Article  Google Scholar 

  43. Maher B, Faruqui A, Horgan M, Bergin C, Tuathaigh CO, Bennett D. Continuing professional development and Irish hospital doctors: a survey of current use and future needs. Clin Med. 2017;17(4):307–15. https://doi.org/10.7861/clinmedicine.17-4-307.

    Article  Google Scholar 

  44. Maher B, O'Neill R, Faruqui A, Bergin C, Horgan M, Bennett D, et al. Survey of Irish general practitioners' preferences for continuing professional development. Educ Prim Care. 2018;29(1):13–21. https://doi.org/10.1080/14739879.2017.1338536.

    Article  Google Scholar 

  45. Markaki A, Antonakis N, Hicks CM, Lionis C. Translating and validating a training needs assessment tool into Greek. BMC Health Serv Res. 2007;7(1):65. https://doi.org/10.1186/1472-6963-7-65.

    Article  Google Scholar 

  46. Markaki A, Alegakis A, Antonakis N. Kalokerinou-Anagnostopoulou a, Lionis C. exploring training needs of nursing staff in rural Cretan primary care settings. Appl Nurs Res. 2009;22(2):138–43. https://doi.org/10.1016/j.apnr.2008.12.002.

    Article  Google Scholar 

  47. Moty BC. Clinical project management portal optimization through change management best practices. In: Master’s thesis. Denton: University of North Texas; 2013. Available at: https://unthsc-ir.tdl.org/handle/20.500.12503/29108.

    Google Scholar 

  48. Mwansisya TE, Mbekenga C, Isangula K, Mwasha L, Pallangyo E, Edwards G, et al. Validation of training need assessment questionnaire among health care workers in reproductive, maternal and newborn health care in low-income countries. Research Square [preprint]2020. https://doi.org/10.21203/rs.3.rs-26276/v1.

  49. Ngidi V. Training needs of medical managers in public hospitals in KwaZulu-Natal. In: Master’s thesis. Durban: University of KwaZulu-Natal; 2012. Available at: http://hdl.handle.net/10413/10874.

    Google Scholar 

  50. Pavlidis G, Downs C, Kalinowski TB, Swiatek-Barylska I, Lazuras L, Ypsilanti A, et al. A survey on the training needs of caregivers in five European countries. J Nurs Manag. 2020;28(2):385–98. https://doi.org/10.1111/jonm.12940.

    Article  Google Scholar 

  51. Shongwe NG. Learning needs assessment for continuous professional development in paediatric acute care nursing: the Eswatini project. In: Master’s thesis. Johannesburg: University of the Witwatersrand; 2019. Available at: https://hdl.handle.net/10539/27982.

    Google Scholar 

  52. Singh S, Sheweta K, Arya S, Gupta SK. Training need assessment of nursing personnel as super specialty tertiary care hospitals in northern India. Int J Health Sci Res. 2015;5(3):262–79.

    Google Scholar 

  53. Tyler C, Hicks C. The occupational profile and associated training needs of the nurse prescriber: an empirical study of family planning nurses. J Adv Nurs. 2001;35(5):644–53. https://doi.org/10.1046/j.1365-2648.2001.01896.x.

    Article  Google Scholar 

  54. Yousif AK, Ahmed OY, Osman WN. Training needs assessment of academic teaching staff in faculty of dentistry, University of Gezira, Sudan 2018. Educ Med J. 2019;11(1):31–41. https://doi.org/10.21315/eimj2019.11.1.4.

    Article  Google Scholar 

  55. Attride-Stirling J. Thematic networks: an analytic tool for qualitative research. Qual Res. 2002;1(3):385–405.

    Article  Google Scholar 

  56. Markaki A, Lionis C. Capacity building within primary healthcare nursing: a current European challenge. Qual Prim Care. 2008;16(3):141–3.

    Google Scholar 

  57. Sifaki-Pistolla D, Chatzea VE, Markaki A, Kritikos K, Petelos E, Lionis C. Operational integration in primary health care: patient encounters and workflows. BMC Health Serv Res. 2017;17(1):788. https://doi.org/10.1186/s12913-017-2702-5.

    Article  Google Scholar 

  58. Whittemore R, Knaf K. The integrative review: updated methodology. J Adv Nurs. 2005;52(5):546–53. https://doi.org/10.1111/j.1365-2648.2005.03621.x.

    Article  Google Scholar 

  59. Mlambo M, Silén C, McGrath C. Lifelong learning and nurses’ continuing professional development, a metasynthesis of the literature. BMC Nurs. 2021;20(1):62. https://doi.org/10.1186/s12912-021-00579-2.

    Article  Google Scholar 

Download references

Acknowledgements

We would like to thank the TNA tool developers, Drs. Deborah Hennessy and Carolyn Hicks, for their input, unwavering support, and strong commitment to sharing their knowledge and expertise with the international community. Also, our appreciation to Dr. Silvia Cassiani, PAHO Regional Officer; Dr. Erica Wheeler, PAHO representative; and the WHO Health Workforce Department representatives for providing helpful background information and connection with stakeholders.

Funding

Not applicable.

Author information

Authors and Affiliations

Authors

Contributions

AM; concept design, synthesis and interpretation of data, drafting and revision of manuscript. SM; data extraction, appraisal and synthesis, drafting of manuscript. RB; literature search, drafting of manuscript. LT; data extraction and synthesis, drafting of manuscript. All authors reviewed and approved the final manuscript.

Corresponding author

Correspondence to Adelais Markaki.

Ethics declarations

Ethics approval and consent to participate

Not applicable (non-human subjects – review study).

Consent for publication

Not applicable.

Competing interests

The authors declare no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Markaki, A., Malhotra, S., Billings, R. et al. Training needs assessment: tool utilization and global impact. BMC Med Educ 21, 310 (2021). https://doi.org/10.1186/s12909-021-02748-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12909-021-02748-y

Keywords