We’re sorry, something doesn't seem to be working properly.
Please try refreshing the page. If that doesn't work, please contact support so we can address the problem.
Factors predicting training transfer in health professionals participating in quality improvement educational interventions
BMC Medical Educationvolume 17, Article number: 26 (2017)
Predictors of quality improvement (QI) training transfer are needed. This study aimed to identify these predictors among health professionals who participated in a QI training program held at a large hospital in the United States between 2005 and 2014. It also aimed to determine how these predictive factors facilitated or impeded QI training transfer.
Following the Success Case Method, we used a screening survey to identify trainees with high and low levels of training transfer. We then conducted semistructured interviews with a sample of the survey respondents to document how training transfer was achieved and how lack of training transfer could be explained. The survey’s response rate was 43%, with a Cronbach alpha of 0.89. We then conducted a thematic analysis of the interview transcripts of 16 physicians.
The analysis revealed 3 categories of factors influencing the transfer of QI training: trainee characteristics, training course, and work environment. Relevant trainee characteristics included attitude toward change, motivation, mental processing skills, interpersonal skills, and the personality characteristics curiosity, humility, conscientiousness, resilience, wisdom, and positivity. The training project, team-based learning, and lectures were identified as relevant aspects of the training course. Work culture, work relationships, and resources were subthemes of the work environment category.
We identified several QI training transfer predictors in our cohort of physicians. We hypothesize that some of these predictors may be more relevant to QI training transfer. Our results will help organizational leaders select trainees who are most likely to transfer QI training and to ensure that their work environments are conducive to QI training transfer.
Health care organizations and health professionals spend substantial amounts of time, effort, and funding on quality improvement (QI) training, yet there is little published evidence about the effectiveness of QI training for clinicians [1, 2]. Several studies and reviews have suggested that the impact of QI training may be mixed [3–7]. It is, therefore, important to understand the circumstances under which QI training is likely to be effective and, in particular, the optimal selection criteria for and characteristics of participants who are likely to successfully manage change in their departments and practices. Baldwin and Ford  defined training transfer in terms of 2 factors: (1) maintenance of newly acquired knowledge and skills and (2) application of newly acquired knowledge and skills to new areas. According to the authors, training transfer occurs when trainees finish the training session and apply what was learned to their work.
Studies have distinguished 3 groups of factors affecting training transfer at work: (1) factors related to the trainee, (2) factors related to the training program, and (3) organizational factors involving both the training program and the trainee [8–13]. The effects of trainee characteristics on training transfer have been investigated in many research studies and reviews [8, 9, 14–16]. In a recent review of the training literature, Salas et al.  included “person analysis” as one of the best practices for maximizing training effectiveness.
To our knowledge, however, no studies have identified the predictors of QI training transfer among health professionals. The goal of this study was to fill this gap in the literature by identifying the factors predicting QI training transfer among health professionals who participated in a QI training program held between 2005 and 2014 at a large health care facility in the south-central United States. This article describes the views of QI training participants and the impact participation in QI training had on the transfer of their training to their practices. The factors and personal attributes predicting QI training transfer were analyzed and described with the aim of helping organizational leaders select trainees who are most likely to transfer QI training and to ensure that their organizations’ work environments are conducive to QI training transfer.
QI training program
The QI training program studied here is funded by a state university system with which the host institution is affiliated. It is offered twice a year and consists of 8 full-day instruction sessions given over a period of 6 months. It requires participants to work in teams of at least 2 trainees and others from their practice area to complete a QI project. It is highly encouraged that each team include at least 1 faculty physician. Besides the physicians, the other participants on the teams include other health care professionals and administrative personnel who typically work together in their everyday environments. The course is voluntary, though division heads and department chairs can invite participants or request that individuals participate. At the conclusion of the program, the trainees are expected to have learned to (1) improve health care systems and processes; (2) identify, measure, and reduce variation in processes; (3) understand the need for multiprofessional and interdisciplinary teamwork in improving patient care; (4) improve health care outcomes; and (5) increase organizational learning by sharing knowledge of best QI practices. The training core components have not been modified over the years the course has been offered.
Research design and sample selection
This study used the Success Case Method, which involves 2 steps: (1) identifying training successes and lack of successes, usually by a screening survey of trainees; and (2) understanding how the trainees’ successes were achieved or not achieved, usually by conducting interviews with a sample of the most and least successful trainees as identified using the survey . The Success Case Method has previously been used to assess training in the health professions by Olson et al. .
An online screening survey was designed by both authors and reviewed for face and content validity by 2 health care quality experts, each with over 25 years of experience. The first 3 questions of the survey were designed based on the critical applications of the QI training program (Additional file 1: Appendix A). The answers to the survey questions were used as training transfer indicators in this research. In addition to asking the training participants about QI projects they developed since participating in the training, we also asked how the trainees applied the skills learned in the training in their practices and departments. The trainees’ descriptions of the QI projects were also verified during the interview process.
We used the training program database to identify all participants in the QI training courses given between 2005 and 2014. The survey was sent via email to the training participants who were still affiliated with the institution at the time of the study. Participants were asked to provide informed consent using the online survey tool, Qualtrics. The following sociodemographic variables with potential impact on training transfer were collected: age, gender, profession, academic role (if any), length of work experience, and training cohort. The responses were weighted as shown in Additional file 1: Appendix A. The respondents with scores in the highest and lowest ranges were sequentially selected for 45- to 60-min semistructured face-to-face or telephone interviews. The sample size was determined by data saturation; data were collected until no new information was gained . We estimated that a sample of 15 to 20 interviewees from each group (the highest and lowest scorers) would provide sufficient data; actual saturation was reached after fewer than 10 interviews in each group. The interviews were conducted using the interview protocol in Additional file 1: Appendix B. The interviews were audiotaped and professionally transcribed.
The survey data were analyzed using SPSS version 21.0 (IBM, Armonk, NY). Descriptive statistics were used to determine the distribution of the sociodemographic variables. Thematic analysis, as described by Braun and Clarke , was used to probe the interview data. All data coding was performed by one of the authors (A.E.) and reviewed by the second author (D.Q.) and the research advisors. Any coding disagreements were discussed and the analysis refined until consensus was reached. Qualitative data analysis was performed using the software MAXQDA version 11.1.0. A mixed-methods analysis was conducted by grouping the interviewees into sets based on their survey scores: a high-transfer group (scores 9–13) and a low-transfer group (scores 0–8). The score cutoffs were decided by consensus among the researchers. The characteristics of these groups were then analyzed in relation to the themes and subthemes that emerged in the interview data in order to understand how the high-transfer and low-transfer groups differed.
The Institutional Review Board of the institution where the research was conducted approved the study (Protocol PA14-0588). All survey participants read and acknowledged an electronic consent document. All interview participants provided consent for audiorecording before the interviews took place. The original data and interview materials will not be shared in order to maintain participants’ confidentiality.
We identified 1044 trainees who participated in the QI training between 2005 and 2014. The recruitment email was sent to the 330 individuals who were still affiliated with the institution at the time of the survey. The survey was completed by 142 (43%) of the trainees who received it. Figure 1 shows the study flowchart. The majority of the respondents (n = 95, 67%) were between 40 and 59 years of age. Sixty-six percent were women. Most (88%) respondents had worked at the institution for more than 5 years. Physicians represented 49% of the respondents; nurses, 40%; physician assistants, 6%; and pharmacists, 5%. One-third (n = 47, 33%) of respondents were from cohorts that underwent the QI training between 2005 and 2009, and 95 (67%) respondents were from cohorts that underwent the QI training between 2010 and 2014. The Cronbach alpha for the survey was 0.89, confirming that the survey instrument was a sufficiently reliable measure of training transfer success.
Of the 142 survey respondents, 86 (61%) consented in advance to participate in a follow-up interview if selected. Because 51 (36%) survey respondents had the highest possible survey score, we decided to narrow our sample and interview only physicians in the qualitative phase of our study. This decision was made by consensus among the research group mainly for practical reasons, as we did not have the resources to interview all high-scoring participants. We also agreed that it was most important to learn about physicians’ experience with the QI training program because they usually assume leadership of QI projects in the institution. We invited 29 physicians whose survey responses placed them in either the high-transfer or low-transfer groups for interviews (18 high scorers and 11 low scorers); of these, 17 (8 high scorers and 9 low scorers) agreed to be interviewed. One interviewee withheld consent for the use of direct quotations from the audio recording. Sixteen of the 17 interviews were transcribed and analyzed; 1 interview was excluded from the analysis because the recording device failed.
The sociodemographic characteristics of the 70 physicians who responded to the survey and 16 physicians whose interview transcripts were analyzed are shown in Table 1.
As shown in Fig. 2, the qualitative and mixed data analyses showed 3 categories of factors found to predict QI training transfer: trainee characteristics, training course, and work environment. These themes were consistent with categories that have previously been identified in the literature. Within each of these 3 categories, several subthemes emerged from the thematic analysis. Five trainee characteristics were identified: attitude toward change, motivation, mental processing skills, interpersonal skills, and 6 personality characteristics (curiosity, humility, conscientiousness, resilience, wisdom, and positivity). The theme training course was divided into 3 subthemes: training project, team-based learning, and lectures. The subthemes of work culture, work relationships, and resources composed the category of work environment. The definitions of some selected themes and subthemes are shown in Additional file 1: Appendix C which shows that these themes and subthemes are the result of merging and grouping of different related codes. An example for that are the 3 personality characteristics resilience, wisdom, and positivity where resilience encompassed codes related to persistence, courage, and self-confidence; wisdom had attributes related to patience and maturity; and positivity consisted of codes related to acceptance and flexibility.
While we identified some trainee characteristics that were consistent with those described in the extant training transfer literature, such as positivity, motivation, and mental processing skills, we also identified several new trainee characteristics that predicted successful QI training transfer: attitude toward change; interpersonal skills; and 5 personality characteristics: curiosity, humility, conscientiousness, resilience, and wisdom (Fig. 2). Sample quotations from interview transcripts that reflect these themes are given in Table 2.
The outcomes of the comparison between the characteristics of trainees in the high-training-transfer and low-training-transfer groups supported the validity of the themes and subthemes. For example, in the subtheme motivation to learn and transfer QI skills, none of the participants in the low-transfer group (scores 0–8) had interview segments coded under this subtheme, but all the participants in the high-transfer group (scores 9–13) had interview segments coded under this subtheme. Another example was the personality characteristic humility, which we defined as a trainee’s having the attributes of humbleness and willingness to learn from others. While none of the participants in the low-transfer group had interview segments coded under this subtheme, all the participants in the high-transfer group had either exhibited this personality characteristic or talked positively about it in their interviews.
Training course design
We identified 3 themes related to the design of the training course that affected QI training transfer, as shown in Fig. 2: the required project, the use of team-based learning, and the lectures given during the training. Both the project and the team-based learning were seen as highly important by the interviewees, as illustrated in the following quotes:
To have a project that’s really meaningful helps because then everybody gets to work on it, and then they see the impact and they appreciate seeing something that’s changed and helped – P145
I think attending that course really opened my eyes about team dynamics and how—what you can learn from that. – P237
Other representative quotations from interview transcripts related to these themes appear in Table 2.
We identified in our interview data 3 themes related to the work environment: work culture, under which we included the subthemes change-driven culture and work stress; work relationships, which we broke down into the subthemes supervisors and peers; and resources, which included the subthemes time and financial (Fig. 2). Some representative quotations related to these themes and subthemes are provided in Table 2.
Using a mixed quantitative (survey) and qualitative (interview) approach, we identified factors predicting training transfer in health professionals who participated in a QI training program at a large hospital in the United States between 2005 and 2014. While some of those training transfer predictors where identified in other studies some such as attitude toward change, motivation, conscientiousness, mental processing skills, interpersonal skills, training course elements, work culture, work relationships, and resources [8, 9, 13, 14, 16, 21–30] we identified different training transfer predictors such as curiosity, humility, resilience.
Implications of the study
Our results will help organizational leaders and quality improvement officers to select the health professionals who are most likely to benefit from QI training interventions and to ensure that their work environments are conducive to QI training transfer. Because health professionals and health care organizations must invest significant amounts of time, effort, and funding in QI training, ensuring the optimal selection of trainees will maximize the positive effects of and return on investment from the training, especially considering the budget constraints many health care institutions currently face. We recommend selecting trainees for QI training programs based on the trainee attributes and personality characteristics identified in this study. One strategy for selecting trainees would be to administer personality inventories to potential participants in QI training. Another option would be to offer pre-training sessions to trainees who score low on measures of the modifiable characteristics, such as motivation and positive attitude toward change. Such sessions could help those trainees acquire the characteristics that predict training transfer success before they begin the QI training.
In future research, we plan to elaborate on 3 of the personality characteristics that have not often been identified in the training transfer literature as a whole: humility, curiosity, and resilience. We speculate that these characteristics may be particularly prominent in trainees who successfully learn and transfer QI skills. Humility helps successful trainees to reflect on their strengths and deficiencies and to be willing to make changes. Curiosity allows trainees to question the status quo and to seek explanations and solutions for existing process problems. Resilience helps trainees to confront resistance to change and overcome challenges impeding improvement. Therefore, we recommend selecting trainees whose personality analysis shows that they have high levels of humility, curiosity, and resilience.
Our study also identified the theme of work culture and its subtheme work stress as important factors predicting QI training transfer. In order to ensure organizational readiness for QI training transfer and to maximize the training’s benefits, leaders should establish a change-driven culture  and implement procedures to reduce work stress.
In addition to the personal and organizational factors predicting QI training transfer, our study identified factors related to the design of QI training courses, such as the training project and team-based learning. In our opinion, these findings have instructional implications that are beyond the scope of this article; they will be the subject of a future publication.
Limitations of the study
Our study had several limitations. First, our screening survey was not psychometrically validated. We note, however, that despite the lack of formal validation, the survey was able to separate the respondents into 2 groups based on the degree of QI training transfer they exhibited. Second, the source of information about training transfer was exclusively the training participants themselves. This may have introduced subjectivity and biases into the data. Other sources, such as the trainees’ peers and supervisors and the training instructors, could also have provided valuable data. However, we were able to minimize, if not eliminate, this bias by designing the survey to measure the application of skills and production of deliverables instead of the trainees’ satisfaction with the course or their acquisition of specific knowledge. Third, our study had a small sample size and was restricted to physicians in a single institution, which may limit the generalizability of our results. Confirming the results of this study through studies of other categories of health professionals and types of institutions will be an important future step in research. Fourth, the data were gathered from individual and not group interviews. Valuable data about team characteristics and dynamics could have been gathered by interviewing teams (for example, through focus groups). Nonetheless, we believe that we collected enough data about team dynamics as well as participants’ perceptions of their teams from the individual interviews. Finally, by the time of the semi-structured interviews, up to 9 years had elapsed since some of the participants completed the QI training. This time lag may have decreased the accuracy and completeness of the collected data, as other QI training experiences may have happened in the interim. This was encountered with only 1 senior participant in the high-score group who participated in the sixth cohort of the training and who had taken QI training courses at other institutions in the past. However, we think that the time lag had only a limited effect on our study results because we identified several personality traits, which are unlikely to change over time, among the factors predicting training transfer. In spite of these limitations, our novel study adds new and unique training transfer predictors to the extant literature. In addition, our results will help leaders of health care organizations to develop methods for selecting the trainees who are most likely to transfer QI training and ensure that work environments are conducive to QI training transfer.
To our knowledge, this is the first study aimed at identifying the factors and personal attributes predicting QI training transfer among health professionals. Our results add to the existing research in the area of QI training transfer. While some factors in QI training transfer are likely universal to any training, we speculate that others are more relevant to QI, such as attitude toward change, personality characteristics (curiosity, humility, and resilience), and change-driven work culture. Our results also show that in order to ensure organizational readiness for QI training transfer, leaders should establish a change-driven culture and implement policies that reduce work stress. We anticipate that the results of our study will help organizational leaders select health professional and physicians who are most likely to transfer QI training which will ultimately contribute in enhancement of health care QI initiatives.
Future research should explore the role of teams in training transfer. Group data are needed in addition to individual data. Future studies should also aim to identify the factors and attributes that relate to QI training transfer among health care professionals other than physicians and compare them to the results of this study.
Patow CA, Karpovich K, Riesenberg LA, Jaeger J, Rosenfeld JC, Wittenbreer M, et al. Residents’ engagement in quality improvement: a systematic review of the literature. Acad Med. 2009;84(12):1757–64.
Rotthoff T, David DM, Scherbaum WA. The effectiveness of CME- quality improvement through differentiated advanced medical education research. Z Evid Fortbild Qual Gesundhwes. 2009;103(3):165–8.
Chakraborti C, Boonyasai R, Wright S, Kern D. A systematic review of teamwork training interventions in medical student and resident education. J Gen Intern Med. 2008;23(6):846–53.
Nie Y, Li L, Duan Y, Chen P, Barraclough BH, Zhang M, et al. Patient safety education for undergraduate medical students: a systematic review. BMC Med Educ. 2011;11(33):1–8.
Abbas MR, Quince TA, Wood DF, Benson JA. Attitudes of medical students to medical leadership and management: a systematic review to inform curriculum development. BMC Med Educ. 2011;11(1):1.
Ogrinc G, Headrick LA, Mutha S, Coleman MT, O’Donnell J, Miles PV. A framework for teaching medical students and residents about practice-based learning and improvement, synthesized from a literature review. Acad Med. 2003;78(7):748–56.
Boonyasai RT, Windish DM, Chakraborti C, Feldman LS, Rubin HR, Bass EB. Effectiveness of teaching quality improvement to clinicians: a systematic review. JAMA. 2007;298(9):1023–37.
Baldwin TT, Ford JK. Transfer of training: a review and directions for future research. Pers Psychol. 1988;41(1):63–105.
Kontoghiorghes C. A systemic perspective of training transfer. In: Schneider K, editor. Transfer of Learning in Organizations. Basel, Switzerland: Springer International Publishing; 2014. p. 65–79.
Nikandrou I, Brinia V, Bereri E. Trainee perceptions of training transfer: an empirical analysis. J Eur Ind Training. 2009;33(3):255–70.
Kontoghiorghes C. Predicting motivation to learn and motivation to transfer learning back to the job in a service organization: a new systemic model for training effectiveness. Perform Improvement Q. 2002;15(3):114–29.
Kontoghiorghes C. Reconceptualizing the learning transfer conceptual framework: empirical validation of a new systemic model. Int J Train Dev. 2004;8(3):210–21.
Grossman R, Salas E. The transfer of training: what really matters. Int J Train Dev. 2011;15(2):103–20.
Burke LA, Hutchins HM. Training transfer: An integrative literature review. Hum Resour Dev Rev. 2007;6(3):263–96.
Salas E, Tannenbaum SI, Kraiger K, Smith-Jentsch KA. The science of training and development in organizations: what matters in practice. Psychol Sci Public Interest. 2012;13(2):74–101.
Colquitt JA, LePine JA, Noe RA. Toward an integrative theory of training motivation: a meta-analytic path analysis of 20 years of research. J Appl Psychol. 2000;85(5):678–707.
Brinkerhoff RO. The success case method: a strategic evaluation approach to increasing the value and effect of training. Adv Developing Hum Resour. 2005;7(1):86–101.
Olson CA, Shershneva MB, Brownstein MH. Peering inside the clock: using success case method to determine how and why practice-based educational interventions succeed. J Contin Educ Health Prof. 2011;31 Suppl 1:S50–9.
Lincoln YS, Guba EG. Naturalistic Inquiry. Beverly Hills, CA: Sage; 1985.
Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006;3(2):77–101.
Tziner A, Fisher M, Senior T, Weisberg J. Effects of trainee characteristics on training effectiveness. Int J Selection Assess. 2007;15(2):167–74.
Holton III EF, Bates RA, Ruona WE. Development of a generalized learning transfer system inventory. Hum Resour Dev Q. 2000;11(4):333–60.
Velada R, Caetano A, Michel JW, Lyons BD, Kavanagh MJ. The effects of training design, individual characteristics and work environment on transfer of training. Int J Train Dev. 2007;11(4):282–94.
Van der Locht M, Van Dam K, Chiaburu DS. Getting the most of management training: the role of identical elements for training transfer. Pers Rev. 2013;42(4):422–39.
Armenakis AA, Harris SG, Mossholder KW. Creating Readiness for Organizational Change. Hum Relations. 1993;46(6):681–703.
Clarke N. Job/work environment factors influencing training transfer within a human service agency: some indicative support for Baldwin and Ford’s transfer climate construct. Int J Train Dev. 2002;6(3):146–62.
Tracey JB, Hinkin TR, Tannenbaum S, Mathieu JE. The influence of individual characteristics and the work environment on varying levels of training outcomes. Hum Resour Dev Q. 2001;12(1):5–23.
Ghosh P, Chauhan R, Rai A. Supervisor Support in Transfer of Training: Looking Back at Past Research. Ind Commercial Train. 2015;47(4):201–7.
Lancaster S, Di Milia L, Cameron R. Supervisor behaviours that facilitate training transfer. J Workplace Learning. 2013;25(1):6–22.
Zabid Abdul R, Sambasivan M, Azmawani AR. The influence of organizational culture on attitudes toward organizational change. Leadersh Org Dev J. 2004;25(1/2):161–79.
We are grateful to Dr. Lori Williams and Dr. Mimi Lee, who contributed to the review of the study methodology and the thematic analysis; Dr. Yisheng Le, biostatistician at The University of Texas MD Anderson Cancer Center; Dr. Margaret Watson, who reviewed the statistical design and analysis; Dr. Paula Iaeger, who helped in the survey design; Dr. Holly M. Hutchins, who offered valuable feedback about the research results; Cathy LaComb, who helped with the trainee data extraction; Maria del Rocio Moguel, who helped with the development of the research database; Dr. Amy Ninetto, who edited the manuscript; and all the health professionals who participated in this study in spite of their busy schedules.
The study was partially funded by an award from the Center for Healthcare Quality & Safety at The University of Texas Health Science Center at Houston.
Availability of data and materials
Original data and material will not be shared in order to maintain participants’ confidentiality.
Both authors made substantive intellectual contributions to the article. Both authors conceptualized and designed the research. A.E. collected, analyzed, and interpreted the data. A.E. drafted the manuscript, and D.Q. revised it critically for important intellectual content. Both authors have given final approval of the version to be published.
Ahmed Eid, MD, MEd, EdD is Associate Professor of Oncology in the Department of General Oncology, The University of Texas MD Anderson Cancer Center, Houston, Texas, USA.
Doris Quinn, PhD is a Consultant in Process Improvement, Emmitsburg, Maryland, USA.
The authors declare that they have no competing interest.
Consent for publication
No individual participants’ data are identified. All interview participants approved including parts of the transcribed interview data in this publication, except 1 interviewee whose data were not included in the analysis.
Ethics approval and consent to participate
The Institutional Review Board where the research was conducted approved the study (Protocol PA14-0588). All survey participants read and acknowledged an electronic consent document. All interview participants signed a separate paper consent document before the interviews took place.
Appendix A. Survey Questionnaire. Appendix B. Interview Protocol. Appendix C. Definitions of Selected Themes and Subthemes. (DOCX 30 kb)