- Research article
- Open Open Peer Review
Motivation for feedback-seeking among pediatric residents: a mixed methods study
BMC Medical Educationvolume 18, Article number: 145 (2018)
For effective self-directed life-long learning physicians need to engage in feedback-seeking, which means fostering such behavior during training. Self-determination theory (SDT) posits that intrinsic motivation is fostered when the environment optimizes the individual’s experience of autonomy, relatedness, and competence. Educational settings meeting these psychological needs may foster intrinsic motivation in trainees, enhance their desire for feedback, and promote feedback-seeking. We sought to examine residents’ feedback-seeking behaviors through the lens of SDT and explore the association with intrinsic motivation and career choice.
We used a mixed-methods approach with an explanatory sequential design. Residents participated in simulation training, completed an inventory of intrinsic motivation (IMI) and responded to sequential opportunities for performance feedback requiring different levels of effort. We compared IMI scores and career choice between groups with different effort. We interviewed high-effort feedback-seekers and conducted thematic analysis of interview data.
Thirty-four of 35 residents completed the survey (97%). Of those completing the study, 12 engaged in low-effort feedback-seeking only, 10 indicated intent for high-effort feedback-seeking and 10 actually engaged in higher effort to get feedback. Groups did not differ in mean IMI scores. Among high-effort feedback-seekers more residents were interested in critical care–related fields compared to the other groups.
We identified 5 themes around autonomy, relatedness, and competence clarifying residents’ reasons for feedback-seeking.
Our findings suggest that among residents, the relationship between motivation and feedback-seeking is complex and cannot be predicted by IMI score. Career plans and relationships with feedback providers impact feedback-seeking, which can inform educational interventions.
Feedback is thought to be essential for skill development and performance enhancement in medical education, but little is known about what motivates medical trainees to seek feedback [1,2,3]. Archer proposed a model for effective feedback in the health professions in which feedback is part of a learner-driven process of reflection built on self-monitoring. Since self-assessment is frequently inaccurate, external feedback is essential for self-monitoring [4, 5]. This insight has led to the conceptualization of informed self-assessment, defined as “the set of processes through which individuals use external and internal data to generate an appraisal of their own ability.”  Informed self-assessment and the associated process of feedback-seeking is thought to be the cornerstone of self-directed, life-long learning, a requirement of all physicians [4, 7]. While undergraduate and graduate medical programs are required to routinely provide trainees with performance feedback; after completion of training, opportunities for structured feedback become rare . Hence, trainees should start to engage in feedback-seeking during medical training.
Published data suggest medical trainees feel they do not get sufficient structured feedback, but to what degree they compensate by seeking out feedback themselves is less clear [9,10,11,12]. The limited available data on feedback-seeking is based on self-report and suggests a few factors that promote feedback-seeking in medical trainees. Feedback-seeking is more common among high-achieving individuals, if feedback is likely to lead to affirmation or have a positive impact on self-image, or if trainees perceive their attending’s supervisory style as supportive [13,14,15,16,17]. Whether self-reported feedback-seeking matches actual behaviors and what promotes such behaviors has received limited attention to date. Self-determination theory (SDT) may provide a useful lens through which to view feedback-seeking behavior and the variables that influence it. SDT posits that in order to encourage intrinsic motivation (defined as free engagement in an activity out of interest or inherent satisfaction) learning environments should promote three characteristics: autonomy, competency, and relatedness [18,19,20]. Autonomy refers to the ability of the individual to choose what they consider a useful course of action. It is supported by creating an environment where learners are empowered to set their own goals and direct their learning. Competency is embodied in the desire to feel effective in action and performance. Relatedness refers to a sense of interconnectedness, belonging, and engagement in reciprocal caring relationships, for example incorporation of the learner into the larger professional or clinical group . Educational environments that meet these psychological needs may foster intrinsic motivation in trainees, enhance their desire for feedback, and thus promote feedback-seeking.
This study aimed to document residents’ actual feedback-seeking behaviors, determine the association with intrinsic motivation and explore potential factors influencing feedback-seeking behavior. We conducted the study in the educational context of simulated pediatric emergencies, which may have different appeal to residents with different career aspirations, and therefore explicitly examined the impact of career choice on feedback-seeking. The overall goal of our study was to gain information on how educational environments can promote feedback-seeking among learners.
Participants and setting
We conducted the study in the context of a simulation-based team-training program for pediatric residents and nurses at our institution. This program, described in detail elsewhere , consists of bi-monthly 1-h sessions focused on emergency situations with 2 scenarios lasting 10–15 min each followed by similar length, semi-structured, group debriefings led by trained instructors. All residents participating in these sessions as team leaders between August 2013 and July 2014 were eligible for the study, which was approved by the University of California San Francisco (UCSF) Committee on Human Research.
We created two sequential opportunities for residents to seek further feedback (beyond that offered during the debriefing) which required different degrees of effort allowing for comparison of trainees who invested more effort with those who invested less. The first opportunity involved written feedback on teamwork skills based on video review of the resident’s performance by two study investigators (DH, TV) using the TeamSTEPPS framework . We imported feedback comments into an on-line instrument (SurveyMonkey™) and gave interested residents access. Seeking out this feedback required low effort – accessing an email link. The second opportunity consisted of a 30 min, in-person feedback session with the principal investigator (DH). The resident had to take initiative for scheduling this session and make time for it; this therefore required higher effort.
We utilized a previously validated tool, the Intrinsic Motivation Inventory (IMI), a 22-item survey with 4 sub-scores on 7-point rating scales, to assess resident motivation as it relates to participating in the simulation. We made minor adaptations to the tool, replacing generic wording in the original tool indicating “an activity” with words that referenced the simulation activity specifically. The first sub-score, Interest/Enjoyment, is a direct self-reported measure of intrinsic motivation, whereas the other 3, Perceived Choice, Perceived Competence, and Pressure/Tension are indirect measures . (Additional file 1: Appendix A).
Using sensitizing concepts from SDT, we created a semi-structured interview guide to examine factors that influenced residents’ participation in an in-person feedback session, their experience with the feedback, and their overall attitude towards feedback-seeking. (Additional file 2: Appendix B).
Figure 1 shows the study design with the different groups based on feedback-seeking opportunities. Immediately following the simulation session, consented residents completed the IMI and indicated their interest in additional performance feedback. Two weeks later, we e-mailed those who indicated interest a link to the written feedback. At the end of the feedback we included questions about their anticipated career choice and their interest in an in-person feedback session. Those who indicated interest were prompted to e-mail the study investigator with potential dates and times for the session. Residents who scheduled an in-person feedback session met individually with the principal investigator (DH) to discuss their performance and subsequently participated in a 30-min semi-structured interview. Interviews were audio-recorded and transcribed. In each phase of the study, residents who indicated interest in additional feedback but did not act on this received one reminder email after 1 month. They were excluded from subsequent phases of the study if they did not pursue their indicated interest (either accessed their feedback or scheduled an in-person session) within 3 months.
We grouped participants according to their feedback-seeking behaviors as indicated in Fig. 1: Group A, low effort feedback-seeking, Group B, intended high effort feedback-seeking, and Group C, actual high effort feedback-seeking. We calculated descriptive statistics for IMI sub-scores and compared scores between the 3 groups using analysis of variance (ANOVA). To analyze the impact of career choice on feedback-seeking, we grouped residents into two categories: those with high need for skills taught in the simulation sessions (Critical Care-related fields, including Critical Care, Neonatology, and Emergency Medicine) and those with lower need (all other subspecialties, primary care, and undecided). We used Fisher’s exact test to compare proportions of residents in each career group among the three study groups.
We used SPSS 16.0™ for all statistical calculations.
Two investigators (DH, SvS) independently coded the first three transcripts, compared codes, and generated a preliminary coding tree. Next, two investigators (DH, TV) each coded two additional transcripts using the preliminary coding tree and finalized the coding scheme which they used to code all remaining transcripts. They compared, discussed, and reconciled differences and a separate investigator (SvS) reviewed the analysis for accuracy. We conducted a thematic analysis of the interview data and used a constant comparison approach to identify and verify themes and sub-themes [27, 28]. We used DeDoose™ to organize and analyze qualitative data.
Of 43 eligible residents, we excluded 8 because of predicted scheduling difficulties for in-person feedback. The remaining 35 residents all consented to the study, completed the IMI and opted to receive written feedback. The response rate was 97% as one resident did not access the written feedback and was excluded from further analysis. Of the remaining 34 residents, 22 (65%) indicated interest in an in-person feedback session, but only 10 (45%) eventually scheduled and attended such a session. Table 1 provides the distribution of residents per study group, and Table 2 summarizes average IMI scores per group. Overall, residents demonstrated moderate levels of intrinsic motivation (average subscale scores between 3.87 and 4.94, 1–7 scale) without significant differences between study groups. Thus, intrinsic motivation, as measured by the IMI, did not differ between residents who engaged in feedback-seeking behaviors requiring different levels of effort. Of the 34 residents included in the analysis, 12 anticipated a career in a critical care-related field, while 22 did not. The group engaged in high effort feedback-seeking contained a higher proportion of residents interested in critical care–related fields compared to the two groups with lower effort feedback-seeking (7/10 in group C, versus 3/12 in group B and 2/12 in group A; P = 0.03; Fisher’s Exact test).
Through analysis of interview data collected among residents who participated in the in-person session we identified 5 themes that clarified their reasons to participate in seeking additional feedback, their experience with the session and their overall experience with feedback. We grouped the themes into three domains mirroring our theoretical underpinnings from SDT: autonomy, relatedness, and competence. Within the domain of autonomy, we identified two themes: “Having a conversation” and “How I learn.” Residents in our study wanted feedback from someone with whom they could engage in a dialogue, processing information in a manner that was meaningful for their own learning. Within the domain of relatedness, we recognized two additional themes: “Importance of trust” and “Importance of shared goals.” Residents reported seeking feedback from someone they trusted and who was likely to share their individualized goals. Finally, in regards to the domain of competence, we isolated the theme: “Improving patient care skills”. We found that residents sought feedback aimed at improving skills they anticipated needing to provide patient care in the future. Table 3 details the themes with representative quotes.
In our study of residents’ feedback-seeking behavior, the majority of residents engaged in feedback-seeking if it required limited effort, but relatively few sought feedback if it required increased effort. We found no association between intrinsic motivation (as measured by the IMI) and feedback seeking behaviors, while there was an association with anticipated career choice: residents interested in critical-care and related fields were more likely to engage in high effort feedback-seeking. While not evident from the quantitative data, our qualitative data offered evidence that factors related to intrinsic motivation contribute to feedback seeking.
Our inability to detect a significant relationship between IMI scores and feedback-seeking has several possible explanations. First, our sample size was small and limited the power to detect significant differences. Second, our hypothesis may simply have been incorrect and feedback-seeking behavior in our educational context is not intrinsically motivated, at least not in a way that is measured by the IMI instrument. This instrument measures motivation as it relates to the simulation experience, which may not represent the focus of intrinsic motivation that drove residents in our study to feedback-seeking.
Our qualitative data however suggest that some form of intrinsic motivation does play a role, with themes that mapped to the different domains of self-determination theory: autonomy, relatedness, and competence. Autonomy manifested in trainees’ desire to engage in a conversation they could direct, relatedness in their discussion of trust and shared goals with the feedback provider, and competence in their focus on accomplishing short and long-term personal goals. These findings are in accordance with prior studies examining self-identified drivers of feedback-seeking behavior among medical trainees. These include perceiving a feedback providing supervisor as supportive, the desire to ask questions, and to learn from feedback [16, 29, 30]. Moreover, our data also resonate with a recent study published by Ramani et al., which highlighted that trainees place value on receiving feedback in the context of a dialogue intended to promote mutual professional growth . In that study residents voiced the importance of corrective feedback, as did the residents in our current study as well as in a prior study in the pediatric residency simulation setting . This finding is consistent with published data on what type of feedback interests residents , and of particular interest in light of self-determination theory because corrective feedback can collide with feelings of competence . Apparently these residents overcome this conflict if they feel they can gain critical skills or patient outcomes are at stake.
Overall, the qualitative data paint a clear picture of what motivated residents in our study to engage in high-effort feedback-seeking and what they valued in the experience: they were interested in a conversation with someone they trusted, shared their goals, and focused on developing skills that were relevant to them. It is therefore not too surprising that career choice was associated with resident’s feedback-seeking behavior. The in-person session put residents in direct conversation with someone in their intended career direction, who therefore has similar goals and skills these residents want to develop. Thus, this in-person session provided an opportunity to establish an “educational alliance”, a relationship with mutual focus on improving performance and professional capabilities [35, 36]. Our data suggest the residents in our study had a goal-oriented approach to feedback-seeking rather than a performance-oriented approach; the former appears to be associated with higher perceived benefits of feedback and thus may enhance feedback seeking . Residents may not have viewed the in-person session as a mechanism to get specific performance feedback related to the simulation, but rather as a chance to work towards goals by connecting with a potential coach. Coaching is gaining traction in medicine because of its specific focus on continuous skill improvement [37, 38]. Aligning opportunities for residents to engage in feedback-seeking with coaching may be an effective means of promoting skills essential for self-directed, life-long learning.
In addition to limited power due to small sample size, our study has other limitations. First, we did not interview residents who chose not to engage in further feedback-seeking behavior and therefore have limited insights into their motivating factors. Second, only one person (DH) conducted the in-person feedback sessions, which could have affected residents’ interest if they lacked a sense of relatedness to this individual. However, only after a “Yes” response did the survey indicate with whom the in-person session would take place. Finally, our study was limited to feedback-seeking behavior in one context (simulated team training) among a single group of learners (pediatric residents) at one institution which may limit generalizability of our findings. We view these limitations as opportunities for additional research, and future studies should examine professional goals and the learning context more carefully to determine how best to reinforce feedback-seeking for a variety of trainees across contexts and disciplines.
The relationship between motivation and feedback-seeking is complex. Providing more opportunities for feedback does not universally increase feedback-seeking and the interaction between career goals and certain elements of self-determination, in particular relatedness and competence, may be more important. At the residency level, seeking context-specific performance feedback may be less relevant than establishing longitudinal professional relationships that encompass aspects of coaching. As trainees are expected to become self-directed learners skilled at informed self-assessment, our educational programs should reflect these priorities. If systems are put in place that offer trainees opportunities to seek feedback from people who can serve as coaches in light of their career aspirations, they may be more likely to actually pursue and value such opportunities for feedback which in turn may promote future feedback-seeking.
Intrinsic Motivation Inventory
Veloski J, Boex JR, Grasberger MJ, Evans A, Wolfson DB. Systematic review of the literature on assessment, feedback and physicians’ clinical performance: BEME guide no. 7. Med Teach. 2006;28:117–28.
Kluger AN, DeNisi A. The effects of feedback interventions on performance: a historical review, a meta-analysis, and a preliminary feedback intervention theory. Psychol Bull. 1996;119:254.
Van De Ridder JMM, Stokking KM, McGaghie WC, Ten Cate OTJ. What is feedback in clinical education? Med Educ. 2008;42:189–97.
Eva KW, Regehr G. “I’ll never play professional football” and other fallacies of self-assessment. J Contin Educ Heal Prof. 2008;28:14–9.
Archer JC. State of the science in health professional education: effective feedback: effective feedback in health professional education. Med Educ. 2010;44:101–8.
Sargeant J, Armson H, Chesluk B, Dornan T, Eva K, Holmboe E, et al. The processes and dimensions of informed self-assessment: a conceptual model. Acad Med. 2010;85:1212–20.
Eva KW, Regehr G. Self-assessment in the health professions: a reformulation and research agenda. Acad Med. 2005;80:S46–54.
Safran C, Shabot MM, Munger BS, Holmes JH, Steen EB, Lumpkin JR, et al. Program requirements for fellowship education in the subspecialty of clinical informatics. J Am Med Inform Assoc. 2009;16:158–66.
Anderson PAM. Giving feedback on clinical skills: are we starving our young? J Grad Med Educ. 2012;4:154–8.
Jensen AR, Wright AS, Kim S, Horvath KD, Calhoun KE. Educational feedback in the operating room: a gap between resident and faculty perceptions. Am J Surg. 2012;204:248–55.
Yarris LM, Linden JA, Gene Hern H, Lefebvre C, Nestler DM, Fu R, et al. Attending and resident satisfaction with feedback in THE emergency department: FEEDBACK IN THE ED. Acad Emerg Med. 2009;16:S76–81.
Levinson KL, Barlin JN, Altman K, Satin AJ. Disparity between resident and attending physician perceptions of intraoperative supervision and education. J Grad Med Educ. 2010;2:31–6.
Sinclair HK, Cleland JA. Undergraduate medical students: who seeks formative feedback? Med Educ. 2007;41:580–2.
Harrison CJ, Könings KD, Molyneux A, Schuwirth LWT, Wass V, van der Vleuten CPM. Web-based feedback after summative assessment: how do students engage? Med Educ. 2013;47:734–44.
Bok HGJ, Teunissen PW, Spruijt A, Fokkema JPI, van Beukelen P, Jaarsma DADC, et al. Clarifying students’ feedback-seeking behaviour in clinical clerkships: clarifying students’ feedback-seeking behaviour. Med Educ. 2013;47:282–91.
Teunissen PW, Stapel DA, van der Vleuten C, Scherpbier A, Boor K, Scheele F. Who wants feedback? An investigation of the variables influencing residents’ feedback-seeking behavior in relation to night shifts. Acad Med. 2009;84:910–7.
Bose MM, Gijselaers WH. Why supervisors should promote feedback-seeking behaviour in medical residency. Med Teach. 2013;35:e1573–83.
Ryan RM, Deci EL. Intrinsic and extrinsic motivations: classic definitions and new directions. Contemp Educ Psychol. 2000;25:54–67.
Ryan RM, Deci EL. Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. Am Psychol. 2000;55:68.
Deci EL, Ryan RM. The’ what’ and’ why’ of goal pursuits: human needs and the self determination of behavior. Psychol Inq. 2000;11:227–68.
ten Cate OTJ, Kusurkar RA, Williams GC. How self-determination theory can assist our understanding of the teaching and learning processes in medical education. AMEE guide no. 59. Med Teach. 2011;33:961–73.
Creswell JW, Clark VP. Designing and Conducting Mixed Methods Research. Third Edition. London: SAGE Publications; 2017.
Greene JC, Caracelli VJ, Graham WF. Toward a conceptual framework for mixed-method evaluation designs. Educ Eval Policy Anal. 1989;11:255–74.
van Schaik SM, Plant J, Diane S, Tsang L, O’Sullivan P. Interprofessional team training in pediatric resuscitation: a low-cost, in situ simulation program that enhances self-efficacy among participants. Clin Pediatr (Phila). 2011;50:807–15.
King HB, Battles J, Baker DP, Alonso A, Salas E, Webster J, et al. TeamSTEPPS™: team strategies and tools to enhance performance and patient safety. 2008;
McAuley E, Duncan T, Tammen VV. Psychometric properties of the intrinsic motivation inventory in a competitive sport setting: a confirmatory factor analysis. Res Q Exerc Sport. 1989;60:48–58.
Creswell JW, Poth CN. Qualitative inquiry & research design: choosing among five approaches. 4th ed. SAGE: Los Angeles; 2018.
DeSantis L, Ugarriza DN. The concept of theme as used in qualitative nursing research. West J Nurs Res. 2000;22:351–72.
Mann K, van der Vleuten C, Eva K, Armson H, Chesluk B, Dornan T, et al. Tensions in informed self-assessment: how the desire for feedback and reticence to collect and use it can conflict. Acad Med. 2011;86:1120–7.
Delva D, Sargeant J, Miller S, Holland J, Alexiadis Brown P, Leblanc C, et al. Encouraging residents to seek feedback. Med Teach. 2013;35:e1625–31.
Ramani S, Post SE, Könings K, Mann K, Katz JT, van der Vleuten C. “It’s just not the culture”: a qualitative study exploring residents’ perceptions of the impact of institutional culture on feedback. Teach Learn Med. 2017;29:153–61.
Plant JL, Corden M, Mourad M, O’Brien BC, van Schaik SM. Understanding self-assessment as an informed process: residents’ use of external information for self-assessment of performance in simulated resuscitations. Adv Health Sci Educ. 2013;18:181–92.
Reddy ST, Zegarek MH, Fromme HB, Ryan MS, Schumann S-A, Harris IB. Barriers and facilitators to effective feedback: a qualitative analysis of data from multispecialty resident focus groups. J Grad Med Educ. 2015;7:214–9.
ten Cate OTJ. Why receiving feedback collides with self determination. Adv Health Sci Educ. 2013;18:845–9.
Telio S, Ajjawi R, Regehr G. The “educational alliance” as a framework for Reconceptualizing feedback in medical education. Acad Med. 2015;90:609–14.
Telio S, Regehr G, Ajjawi R. Feedback and the educational alliance: examining credibility judgements and their consequences. Med Educ. 2016;50:933–42.
Tofade T. Coaching younger practitioners and students using components of the co-active coaching model. Am J Pharm Educ. 2010;74:51.
Greenberg CC, Ghousseini HN, Pavuluri Quamme SR, Beasley HL, Wiegmann DA. Surgical coaching for individual performance improvement. Ann Surg. 2015;261:32–4.
We would like to thank all the pediatric residents who participated in the study.
The authors report no external funding source for this study.
Availability of data and materials
All data and study materials are available from the authors by request.
Ethics approval and consent to participate
This study was reviewed by the UCSF Committee on Human Research and was deemed exempt from needing ethical approval. We obtained written consent from subjects prior to participation in the study.
Consent for publication
The authors declare they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendix A. Intrinsic Motivation Inventory. Includes the intrinsic motivation inventory (IMI) which we adapted to the specific activity of running a mock code. Information on how to calculate sub-scores for the IMI is included at the end of the inventory. (DOCX 114 kb)
Appendix B. Interview Guide. Includes our interview guide with questions designed to explore participants’ general experience with feedback as well as investigate constructs related to Self-Determination Theory. (DOCX 85 kb)