- Research article
- Open Access
- Open Peer Review
Content counts, but context makes the difference in developing expertise: a qualitative study of how residents learn end of shift handoffs
BMC Medical Education volume 18, Article number: 249 (2018)
Handoff education is both formal and informal and varies widely across medical school and residency training programs. Despite many efforts to improve clinical handoffs, little evidence has shown meaningful improvement. The objective of this study was to identify residents’ perspectives and develop a deeper understanding on the necessary training to conduct safe and effective patient handoffs.
A qualitative study focused on the analysis of cognitive task interviews targeting end-of-shift handoff experiences with 35 residents from three geographically dispersed VA facilities. The interview data were analyzed using an iterative, consensus-based team approach. Researchers discussed and agreed on code definitions and corresponding case examples. Grounded theory was used to analyze the transcripts.
Although some residents report receiving formal training in conducting handoffs (e.g., medical school coursework, resident boot camp/workshops, and handoff debriefing), many residents reported that they were only partially prepared for enacting them as interns. Experiential, practice-based learning (i.e., giving handoffs, covering night shift to match common issues to handoff content) was identified as the most suited and beneficial for delivering effective handoff training. Six skills were described as critical to learning effective handoffs: identifying pertinent information, providing anticipatory guidance, applying acquired clinical knowledge, being concise, incorporating delivery strategies, and appreciating the styles/preferences of handoff recipients.
Residents identified the immersive performance and the experience of covering night shifts as the most important aspects of learning to execute effective handoffs. Formal education alone can miss the critical role of real-time sense-making throughout the process of handing off from one trainee to another. Interventions targeting senior resident mentoring and night shift could positively influence the cognitive and performance capacity for safe, effective handoffs.
End-of-shift patient handoffs, also known as transfers-of-care or sign-outs, pose a substantial patient safety risk and an opportunity for quality improvement. These transitions lead to unwanted variation in handoffs and have been associated with delays in diagnosis and treatments , duplication of tests or treatment and patient discomfort , inappropriate care and less functional training for health care personnel , medication errors and failure to follow a patient’s code status , and longer hospital stays and increased laboratory testing [5, 6]. The Accreditation Council for Graduate Medical Education (ACGME) requires teaching hospitals to develop residents’ competency in communicating with team members during the handoff process . Proposed curricula for medical students and residents in end-of-shift handoffs , as well as interventions that improve transfer processes, have resulted in meager changes in practice and growing awareness that one size of training does not fit all kinds of handoffs [9, 10]. Training for end-of-shift handoff competency is infrequently included in formal medical education and, where it is, the content and structure of the training varies widely . Instead, end-of-shift handoffs are typically learned “on the job,” from interns or residents, who likely learned them in the same manner . The clash between formal training and local practice culture (i.e., “the way things are done around here”) may contribute to the considerable variation observed in handoff effectiveness [13,14,15,16].
Handoffs are a complex form of social interaction that occur in “microsystems,”  defined as groups of clinicians and staff with a shared clinical purpose and legal responsibility to provide care. Formal “onboarding” training-- the action or process of integrating a new employee into an organization for new physicians in training, is accompanied by informally acquired knowledge and expectations about the day-to-day operation of the microsystem. Differences in local culture have been identified as a major contributor to variations in individual and the microsystem performance and may, in part, explain why interventions that call for rigid adherence to uniform standards have been unsuccessful .
Recent literature suggests a change in the conceptualization of handoffs from a mechanical transfer of accurate and complete patient information, to a highly nuanced, contextually sensitive and emergent social-technical communication event [18, 19]. To date, developers of handoff improvement strategies have paid little attention to the complexities of workflow. Competing cognitive, linguistic, technical and physical demands influence the success of a handoff, but are not routinely considered part of the educational process for leaning and improvement [20, 21]. Identifying and enhancing the capacity of clinicians to make sense (clinical sensemaking) of these complexities in patient care is crucial . A sense-making approach that focuses on the motivation of clinicians who are jointly responsible for patient care, rather than focusing solely on errors or root causes, may contribute to the development and implementation of effective and sustainable interventions .
The objective of this study was to gain insights into residents’ perspectives on the local cultural assumptions and contextual factors that shape their knowledge about, and skills of enacting effective handoffs. In this paper, we report our findings related to the formal, and importantly, the “hidden” or informal curriculum that residents reported being exposed to in developing these skills.
Setting and participants
We conducted a prospective, multi-method, qualitative study. Data collection included semi-structured cognitive task interviews with medicine and surgery residents at three geographically dispersed VA Medical Centers (VAMCs). Site investigators and chief residents supplied names of potential residents to recruit for a cognitive task interview and to have their handoffs videotaped. Recruited participants were then asked to provide additional names of peers who might be open to participating, a form of snowball sampling . Research assistants met with interested providers, informed them about the study, and obtained their written consent to participate. Residents received a $100.00 gift card for participation in the interview. Ethics approval was obtained from the Indiana University Institutional Review Board and VAMC Research and Development Human Subjects board.
Data were collected from individual Cognitive Task Analysis (CTA) interviews. This method extends the critical decision method of Klein, Calderwood, & Macgregor , later adapted by Militello and Hutton, and generally includes a combination of observations and semi-structured interviews . CTA enables elicitation of factors that experienced professional face while engaging in complex clinical tasks [27,28,29,30]. Specifically, participants are asked to recall their last handoff and describe 4 to 5 major steps in the process. Cognitive probes were used to explore training/experience, cues, goals, strategies, and information needs and tools used during each step of the handoff process. An interview guide is included as Additional file 1.
The CTA interviews were conducted in a quiet location in the hospital, audio-recorded and transcribed verbatim according to a standardized format. Team members verified that the recordings matched the transcripts an d corrected any transcription inaccuracies.
Interview data were analyzed using a grounded theory approach to explore key social processes and structures . The interviews were coded using qualitative software NVivo . Emerging codes were circulated among authors and the list of codes was developed into a code-book during face-to-face meetings, conference calls, and email correspondence. Regular conference calls were held to refine the codebook as other codes emerged during the analysis process. In building the inventory of codes, portions of the text and provisional codes were compared and differences reconciled in a series of iterative consensus-building meetings until thematic saturation was reached (e.g., no new codes emerged) .
One member of the data analysis team was responsible for updating and maintaining a master file of the consensus coded transcripts (NR). Iterative reviews using the constant comparative method, resulted in assignment of codes to mutually exclusive categories. We report here on the findings related to “training and experience” that were derived from the interviews; study findings on how residents prepare for handoffs have been published elsewhere . A confirmability audit to ensure dependability of the training and experience category analysis was conducted to match code definitions with transcript case examples.
A total of 35 residents were interviewed. Demographics are summarized in Table 1. Data analysis resulted in 2 main themes that emerged: (i) formal and (ii) informal training experiences and three main skills as described below.
Formal training experiences
Formal training strategies included: medical school curriculum (e.g., handoff class, handoff practice, simulation, observation opportunities); resident/ intern orientation handoff boot camp/workshops; and debriefing handoffs to identify necessary information to be included.
Informal training experiences
Informal, “on-the-job” training experiences were reported as having a stronger influence on actual practices than formal instruction. Residents described three specific handoff-related types of skills: 1) acquiring and applying knowledge to anticipate patient needs and tasks; 2) aligning information needs to work tasks (content and amount); and 3) adapting to the handoff to the setting and context (see Table 2 for a summary of skills and exemplar quotations). We have broken down each of these types into two specific skills.
Skill 1: Acquire and apply knowledge to anticipate patient needs and tasks
Residents recognized that acquiring specific and targeted clinical knowledge continued during residency and influenced their ability to communicate anticipatory guidance and tasks for the upcoming shift during handoffs.
Skill 1a. Apply newly acquired clinical knowledge
Residents reported that the quality of their handoffs improved over time as their clinical understanding of patient disease trajectories and medical treatments expanded. Continued learning resulted from month-long rotations on different medical wards and exposure to a variety of cases. Learning also occurred informally when senior residents “intervened” (i.e. ask a question, interrupt to clarify, etc.) during challenging handoffs. One resident (P101) described this type of learning as follows: “When you first start residency like your senior resident is always there with you when you’re signing out to kind of jump in when the night person asks you a question…” Additionally, residents developed a better understanding of the implicit language of handoffs: “I think there is a lot of hidden language in sign out, the way you describe a patient to somebody else,[and] in the way that words are constructed and the sign out itself is constructed.” (P123).
Skill 1b. Provide anticipatory guidance and assign tasks
Anticipatory guidance was reported to provide incoming residents with an early guide to issues that might arise during the next shift. Typically, this type of information included relaying past patient responses to medication or procedures, and communicating clinical trajectories, potential or desired outcomes and care needs. For example, anticipatory guidance might include how a patient responded to a specific diuretic dose, how his vital signs varied, reactions and follow-up plans, patient triaging, anticipating nursing questions, tasks to complete, using baseline status for comparison, and alternate care plans if certain conditions occurred during the night shift.
Residents also adopted a simple binary vocabulary for indicating the acuity of a patient’s condition, “sick” or “not sick.” “Sick” referred to patients who could decompensate during the upcoming shift, while “not sick” referred to patients who only needed routine monitoring. The ability to offer anticipatory guidance improved with continued clinical experience and explicit feedback on previous handoffs.
Skill 2: Align information needs to work tasks
Residents consistently noted that including the ‘right’ information in the ‘right’ amount was a key and new skill developed to give organized, clear handoffs. One resident (P103) explained that: “It takes a lot of practice—after you’ve done these sign-outs for months on end, you know the important points to hit on.”
Skill 2a. Identify pertinent information
Residents described the skill of providing patient information as one that best informs the receiver of what they will need to do during their upcoming shift. Communicating pertinent information was contrasted with mechanically reciting a problem list. For example, residents discussed how to convey patient acuity by interpreting aspects of seemingly routine updates, such as mental status exam: “I will ask them those same [mental health] questions overnight, and if things are ‘off’ at all, like that’s gonna tip me off to do more, or if it’s exactly the same, I’ll worry about it less”. (P118).
One striking example of on-the-job learning emerged as residents completed night shift rotations. Prior to staffing overnight shifts, classroom learning had suggested handoffs were standardized, whether from day to night or night to day. Yet, during “night float” rotations, which refer to when residents cover the night shift, they typically monitored and intervened with patients only when necessary. One resident (P129) described the experiential learning process: “When you experience the night float … you start knowing what is important, what is not important. So when you put yourself in the call team’s shoes and then as night float, and you know what’s important and what’s not important.”
Skill 2b. Be concise
Residents valued concision and described streamlining the amount of information they included in their handoffs. In this way, they could focus only on items of critical importance. Economy of actions was achieved by limiting detailed descriptions of contingency plans, the amount of background information, and the problem list to 1–2 of the most pressing problems. Compared to start of their internship year, by the end residents reported they had mastered the skill of giving concise handoffs. For example, one resident (P117) stated, “July 1, it’s like every detail ever and like no consolidation or paring down of anything. It’s just like verbal diarrhea, and you’re like, ‘I don’t know what to make of this,’ I feel like Sherlock Holmes.” July 1 represents the beginning of residency training in North America. More concise handoffs translated into more effective care by making information actionable during the upcoming shift.
Rather than following a list of prescribed elements learned in didactic sessions, practice had taught them to focus on, and prioritize, the most important and time sensitive information: “They teach us [that] you need to give a whole hospital course, a whole history of present illness leading up to this hospitalization, …then you go, ‘I’m gonna make sure that I cover all of my bases by talking about everything.’ When you do that, sign-outs take an hour long…” (P111).
Skill 3: Adapting handoffs to the setting and context
Another critical skill related to concision by eliminating redundancy without omitting important information was making adaptations in delivery strategies and accommodating to incoming resident’s preferences and background.
Skill 3a. Incorporate helpful delivery strategies
Residents described several different strategies they incorporated into their handoffs including acclimating to noisy environments and providing thorough paper-based back up information. One resident (P125) emphasized the importance of painting a picture or relaying a weird story to help the incoming resident remember individual patients. Some strategies were taught by senior residents during handoffs; others learned by observing how colleagues handled the process. Helpful handoff strategies varied considerably and were not formally taught. Tips, tricks and shortcuts described by residents did not have the force of institutional authority, or formal rules, regulations and procedures, but rather, they were part of the informal curriculum of resident education.
Skill 3b. Appreciate others’ styles/preferences for handoffs
Residents learned from their experience to identify and adjust to other resident preferences for giving and receiving information. For example, residents described variations in the preferred level of detail to be included in a handoff based on previous experiences with other residents. Some also reported adapting their handoffs based on the receiver’s “reputation” or behavioral cues. In both cases, adaptations were based on implicit assumptions about an incoming resident’s preferences: “Some people are very detail oriented; some people are big picture oriented; some people like to talk and are social during their sign-outs; some people are not.” (P111) In terms of behavioral cues, some incoming residents used nonverbal cues to indicate that a handoff was too long by diverting attention elsewhere and not listening.
Our findings indicate that critical skills for enacting effective patient handoffs were mostly learned informally through observation and experience. Study participants described how immersion in the local microsystem culture was the best teacher in terms of mastering skills.
Our analysis uncovered six skills viewed by residents as critical to handoff quality: identifying pertinent information, providing anticipatory guidance, applying acquired clinical knowledge, being concise, incorporating delivery strategies, and appreciating styles/preferences for handoffs. Our findings also highlight the dynamic cognitive work required to enact safe and effective handoffs and the importance of shared goals, shared knowledge, and mutual respect between providers. These “relational dynamics” can in turn predict higher levels of quality . These skills require a high level of interpersonal knowledge and sense-making that is critical for accurate assessment of patient status and care needs, care planning, interpersonal and setting-specific issues, and handoff content [22, 23]. Sense-making is the integration of both tacit and explicit knowledge of a situation and is a basis for social action . Our findings demonstrate how residents use sense-making activities to coordinate complex actions like the transfer of rights, duties and responsibilities between providers involved in end of shift handoffs. Too great a focus on content alone can miss the critical role of sense-making and interpretation that “house” the handoff process. Attempts to design effective handoff interventions should balance the urge to standardize with explicating the role of self and situation awareness in handoff interactions .
Interestingly, residents did not focus on handoff mechanics, content, or preferred formats. Instead, practical concerns relating to informal organizational culture and experience and how it influenced their workflow made up the bulk of their comments. Our findings suggest that the ability to detect nuanced messages and adapt accordingly is a subtle interpersonal skill that emerges only when a resident has mastered the mechanics of handing off complex patients. Perhaps, only then does the resident have the cognitive resources to attend to the recipient’s skills, attention level, and real-time reactions to the information being conveyed. Residents also reported being less willing to confront each other about handoff defects and inefficiencies which may explain resident self-reported high ratings of their handoffs . Skill acquisition is difficult in the absence of feedback [37, 38]; a goal for future improvement interventions. Safety of patients may also be compromised by a false sense of confidence that emerges when handoff strategies are not rigorously assessed .
We have several suggestions for improving handovers based on experiential learning pedagogy. First, changing attitudes may be enhanced through establishing collaborative learning meetings between medical students, interns and residents to better understand each other’s perspectives, competencies (knowledge, skills, and inferences) and expectations . Simulated handoff cases in which ambiguous or incomplete information is communicated could be used to stimulate discussion about sense-making and the tacit (unspoken) rules of social interaction. Direct feedback by incoming resident or by independent monitor during handoff may be greatly beneficial especially during early months of internship or junior residency.
Second, we suggest providing point-of-care education programs that connect best practices with patient safety and efficiency goals . In this way, the hospital providers may better understand how their own thinking and actions impact quality and safety . One approach, used successfully in infection control, is video-reflexive ethnography in which clinicians view video footage of their actions to identify vulnerabilities for spreading infection. This approach allows participants to understand the consequences of their actual behaviors (including those that seem irrelevant), question their habits of practice, and expand reassessment to behaviors outside the video footage (e.g., reduced infections  improved handoff communication ). Incorporating a video-reflexive session for resident handoffs might reveal non-verbal behaviors, speech pace, and other habits that seemingly are unrelated to effective handoffs.
Third, both classroom and on-the-job mentoring could be enriched by the use of stories or “vignettes” that are meaningful and memorable to residents, because they demonstrate the direct link between handoff processes and their effects on patient care . Incorporating stories and connections is one scaffolding technique for making handoff curricula salient for learners because they demonstrate the direct link between handoff processes and their effects on patient care . In addition, as shown in this study, enacting actual handoffs was viewed as the most effective learning method for developing mastery. Medical students and trainees need “live” opportunities to learn how to conduct handoffs safely and receive feedback.
The study has several limitations. First, data were analyzed and compared at three VA sites with distinct local cultures. Nevertheless, the emergence of the same skills across sites increases the credibility and trustworthiness of the findings. We made all efforts to ensure methodological rigor and validity across the study sites by using a standardized codebook, meeting and talking frequently, sharing and comparing our results. Second the data reflect participant “reports” about their experiences – and could be subject to response bias . Cognitive task analysis is a non-judgmental process that, in principle, reduces, but does not eliminate unwanted bias. Third, the modest number of participants may not be representative of all medical residents’ handoff education or practice.
Our findings underscore the complex social structure of end-of-shift handoffs with implications for handoff training curricula and efforts to improve effectiveness . The use of individual interviews provided invaluable insights into the subtleties of decision-making, and the underlying shared values, beliefs, assumptions, and norms of that characterize the handoff process. While complex and difficult to define, focusing on sense making and contextual features of handoffs can potentially help residents develop the expertise needed to ensure and safety across care transitions .
The Accreditation Council for Graduate Medical Education (ACGME)
Cognitive Task Analysis
VA Medical Centers
Gandhi TK. Fumbled handoffs: one dropped ball after another. Ann Intern Med. 2005;142(5):352–8.
Hesselink G, Schoonhoven L, Barach P, Spijker A, Gademan P, Kalkman C, et al. Improving patient handovers from hospital to primary care: a systematic review. Ann Intern Med. 2012;157(6):417–28.
Horwitz LI, Moin T, Krumholz HM, Wang L, Bradley EH. Consequences of inadequate sign-out for patient care. Arch Intern Med. 2008;168(16):1755–60.
Arora V, Johnson J. A model for building a standardized hand-off protocol. Jt Comm J Qual Patient Saf. 2006;32(11):646–55.
Toccafondi G, Albolino S, Tartaglia R, Guidi S, Molisso A, Venneri F, et al. The collaborative communication model for patient handover at the interface between high-acuity and low-acuity care. BMJ Qual Saf. 2012;21(Suppl 1):i58–66.
Lofgren RP, Gottlieb D, Williams RA, Rich EC. Post-call transfer of resident responsibility: its effect on patient care. J Gen Intern Med. 1990;5(6):501–5.
ACGME Common Program Requirements http://www.acgme.org/Portals/0/PFAssets/ProgramRequirements/CPRs_2017-07-01.pdf Accessed 30 Jan 2018.
Drachsler H, Kicken W, van der Klink M, Stoyanov S, Boshuizen HP, Barach P. The handover toolbox: a knowledge exchange and training platform for improving patient care. BMJ Qual Saf. 2012;21(Suppl 1):i114–20.
Kicken W, Van der Klink M, Barach P, Boshuizen HP. Handover training: does one size fit all? The merits of mass customisation. BMJ Qual Saf. 2012;21(Suppl 1):i84–8.
Keebler JR, Lazzara EH, Patzer BS, Palmer EM, Plummer JP, Smith DC, et al. Meta-analyses of the effects of standardized handoff protocols on patient, provider, and organizational outcomes. Hum Factors. 2016;58(8):1187–205.
Horwitz LI, Krumholz HM, Green ML, Huot SJ. Transfers of patient care between house staff on internal medicine wards: a national survey. Arch Intern Med. 2006;166(11):1173–7.
Babu MA, Nahed BV, Heary RF. Investigating the scope of resident patient care handoffs within neurosurgery. PLoS One. 2012;7(7):e41810.
Carroll JS, Williams M, Gallivan TM. The ins and outs of change of shift handoffs between nurses: a communication challenge. BMJ Qual Saf. 2012;21(7):586–93.
Borowitz SM, Waggoner-Fountain LA, Bass EJ, JM DV. Advances in patient safety resident sign-out: a precarious exchange of critical information in a fast-paced world. In: Henriksen K, Battles JB, Keyes MA, Grady ML, editors. Advances in patient safety. Rockville: Agency for Healthcare Research and Quality (US); 2008.
Volpp KG, Grande D. Residents’ suggestions for reducing errors in teaching hospitals. N Engl J Med. 2003;348(9):851–5.
Frankel RM, Flanagan M, Ebright P, Bergman A, O'Brien CM, Franks Z, et al. Context, culture and (non-verbal) communication affect handover quality. BMJ Qual Saf. 2012;21(Suppl 1):i121–8.
Mohr J, Batalden P, Barach P. Integrating patient safety into the clinical microsystem. Qual Saf Health Care. 2004;13(Suppl 2):ii34–8.
Cohen MD, Hilligoss B, Kajdacsy-Balla Amaral AC. A handoff is not a telegram: an understanding of the patient is co-constructed. Crit Care. 2012;16(1):303.
Cohen MD, Hilligoss PB. The published literature on handoffs in hospitals: deficiencies identified in an extensive review. Qual Saf Health Care. 2010;19(6):493–7.
Lilford RJ, Chilton PJ, Hemming K, Girling AJ, Taylor CA, Barach P. Evaluating policy and service interventions: framework to guide selection and interpretation of study end points. BMJ. 2010;341:c4413.
Johnson JK, Farnan JM, Barach P, Hesselink G, Wollersheim H, Pijnenborg L, Kalkman C, Arora VM. Searching for the missing pieces between the hospital and primary care: mapping the patient process during care transitions. BMJ Qual Saf. 2012;21(Suppl 1):i97–105.
Barach P, Phelps G. Clinical sensemaking: a systematic approach to reduce the impact of normalised deviance in the medical profession. J Royal Soc Med. 2013;106(10):387–90.
Weick KE, Sutcliffe KM, Obstfeld D. Organizing and the process of Sensemaking. Organ Sci. 2005;16(4):409–21.
Heckathorn DD. Snowball versus respondent-driven sampling. Sociol Methodol. 2011;41(1):355–66.
Klein GA, Calderwood R, MacGregor D. Critical decision method for eliciting knowledge. IEEE Trans Syst Man Cybern. 1989;19(3):462–72.
Militello L, Hutton R. Applied cognitive task analysis (ACTA): a practitioner’s toolkit for understanding cognitive task demands. Ergonomics. 1998;41(11):1618–41.
Christensen RE, Fetters MD, Green LA. Opening the black box: cognitive strategies in family practice. Ann Fam Med. 2005;3(2):144–50.
Patterson MD, Militello LG, Bunger A, Taylor RG, Wheeler DS, Klein G, Geis GL. Leveraging the critical decision method to develop simulation-based training for early recognition of sepsis. J Cogn Eng Decis Mak. 2016;10(1):36–56.
Crandall B, Calderwood R. Clinical assessment skills of experienced neonatal intensive care nurses: national center for nursing research. Natl Inst of Health. 1989.
Dominguez CO, Hutton R, Flach JM, McKellar DP. Perception-action coupling in endoscopic surgery: a cognitive-task analysis approach. 1995.
Glaser B. Discovery of grounded theory: strategies for qualitative research. London: Routledge; 2017.
NVivo qualitative data analysis software. In., vol. Version 10. QSR International Pty Ltd. ; 2012.
Walker JL. Research column. The use of saturation in qualitative research. Can J Cardiovasc Nurs. 2012;22(2):37-46.
Militello LG, et al. “Workin’ on our night moves”: how residents prepare for shift handoffs. Jt Comm J Qual Patient Saf. 2018;44(8):485–93.
Gittell JH. Relational coordination: coordinating work through relationships of shared goals, shared knowledge and mutual respect. In: Kyriakidou O, Ozbilgin MF. Relational perspectives in organizational studies. Cheltenham: Edward Elgar; 2006.
Patterson ES, Wears RL. Patient handoffs: standardized and reliable measurement tools remain elusive. Jt Comm J Qual Patient Saf. 2010;36(2):52–61.
Shanteau J. Competence in experts: the role of task characteristics. Organ Behav Hum Decis Process. 1992;53(2):252–66.
Hoffman RR, Ward P, Feltovich PJ, DiBello L, Fiore SM, Andrews DH. Accelerated expertise: training for high proficiency in a complex world. London: Psychology Press; 2013.
Stoyanov S, Boshuizen H, Groene O, van der Klink M, Kicken W, Drachsler H, Barach P. Mapping and assessing clinical handover training interventions. BMJ Qual Saf. 2012;21(Suppl 1):i50–7.
Riesenberg LA, Leitzsch J, Little BW. Systematic review of handoff mnemonics literature. Am J Med Qual. 2009;24(3):196–204.
Clarke CM, Persaud DD. Leading clinical handover improvement: a change strategy to implement best practices in the acute care setting. J Patient Saf. 2011;7(1):11–8.
Iedema R, Hor S-Y, Wyer M, Gilbert GL, Jorm C, Hooker C, O'Sullivan MVN. An innovative approach to strengthening health professionals’ infection control and limiting hospital-acquired infection: video-reflexive ethnography. BMJ Innov. 2015;1(4):157–62.
Calaman S, Hepps JH, Bismilla Z, Carraccio C, Englander R, Feraco A, et al. The creation of standard-setting videos to support faculty observations of learner performance and entrustment decisions. Acad Med. 2016;91(2):204–9.
Weick KE, Sutcliffe KM. Managing the unexpected: resilient performance in an age of uncertainty. San Francisco: Jossey-Bass; 2007.
Orne MT. On the social psychology of the psychological experiment: with particular reference to demand characteristics and their implications. Am Psychol. 1962;17(11):776–83.
Grol R, Grimshaw J. From best evidence to best practice: effective implementation of change in patients’ care. Lancet. 2003;362(9391):1225–30.
Shekelle PG, Pronovost PJ, Wachter RM, Taylor SL, Dy SM, Foy R, et al. Advancing the science of patient safety. Ann Intern Med. 2011;154(10):693–6.
We appreciate the efforts of Paige DeChant in data collection and analysis, and Dr. Maddamsetti Rao, Christopher Kurtz, Ava Harms, Angela Kuramoto, Naomi Ashlely, and Natalia Skorohod for assistance in recruitment and logistics. We would also like to thank the VA residents that volunteered to take out of their regular duties to participate in the study.
The research was funded by the Center for Health Information and Communication, Department of Veterans Affairs (VA), Veterans Health Administration, Health Services Research and Development Service (CIN 13–416), Project No. IIR 12–090. The funder had no role in the design of this study and did not have any role during its execution, analyses, interpretation of the data, or decision to submit results.
Availability of data and materials
Upon request, the co-authors will consider requests for the final dataset. These requests for access will be reviewed by the Richard L Roudebush VA Medical Center R&D Committee and Associate Chief of Staff (ACOS) for Research and addressed within a reasonable timeframe. The limited dataset will include deidentified data relevant to the specific request.
Ethics approval and consent to participate
Site investigators and chief residents supplied names of potential residents to recruit for a cognitive task interview and to have their handoffs videotaped. Recruited participants were then asked to provide additional names of peers who might be open to participating. Research assistants met with interested providers, informed them about the study, and obtained their written consent to participate. Ethics approval was obtained from the Indiana University Institutional Review Board and VAMC Research and Development Human Subjects board.
Consent for publication
Each of the authors declares that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.