Skip to main content
Download PDF

An observational study of self-monitoring in ad hoc health care teams

BMC Medical Education volume 20, Article number: 201 (2020) Cite this article

Abstract

Background

Working in ad hoc teams in a health care environment is frequent but a challenging and complex undertaking. One way for teams to refine their teamwork could be through post-resuscitation reflection and debriefing. However, this would require that teams have insight into the quality of their teamwork. This study investigates (1) the accuracy of the self-monitoring of ad hoc resuscitation teams and their leaders relative to external observations of their teamwork and (2) the relationship of team self-monitoring and external observations to objective performance measures.

Methods

We conducted a quantitative observational study of real-world ad hoc interprofessional teams responding to a simulated cardiac arrest in an emergency room. Teams consisting of residents, consultants, and nurses were confronted with an unexpected, simulated, standardized cardiac arrest situation. Their teamwork was videotaped to allow for subsequent external evaluation on the team emergency assessment measure (TEAM) checklist. In addition, objective performance measures such as time to defibrillation were collected. All participants completed a demographic questionnaire prior to the simulation and a questionnaire tapping their perceptions of teamwork directly after it.

Results

22 teams consisting of 115 health care professionals showed highly variable performance. All performance measures intercorrelated significantly, with the exception of team leaders’ evaluations of teamwork, which were not related to any other measures. Neither team size nor cumulative experience were correlated with any measures, but teams led by younger leaders performed better than those led by older ones.

Conclusion

Team members seem to have better insight into their team’s teamwork than team leaders. As a practical consequence, the decision to debrief and the debriefing itself after a resuscitation should be informed by team members, not just leaders.

Peer Review reports

Background

Health care is an inherently social and interdisciplinary endeavour [1, 2]. Take, for example, emergency departments, where teams of physicians, nurses, and other health care professionals are routinely involved in diagnosing and treating patients [1, 3,4,5]. Collaboration is particularly common in high-urgency situations such as trauma calls or resuscitations that are typically handled by ad hoc teams (also known as health care action teams or interdisciplinary action teams): interdisciplinary, interprofessional groups of specialized individuals who work together in a highly dynamic, complex situation and under time pressure to accomplish critical tasks [6].

Especially when time is of the essence, the performance of such teams critically depends on the quality of their teamwork [7, 8], a term that summarizes “human factors and non-technical skills (leadership, [collaboration], situation awareness and decision making)” [9]. For example, Tiel and colleagues demonstrated that patient mortality is lower when trauma teams are trained in teamwork, including leadership skills [10]. One such key skill is coordination [11] or, as Marks et al. put it, “orchestrating the sequence and the timing of interdependent actions” [12]. Teamwork in emergencies furthermore should be contextually adaptive and account for team member experience and patient acuity [13].

Obviously, developing such teamwork requires training and experience of team members. Plenty of publications describe simulations to address this need (e.g., [14,15,16,17,18,19]). A few common training aims, often referred to as crew (or crisis) resource management principles (CRM), are widely adopted [20]. This conception implicitly assumes that training CRM in one ad-hoc team transfers to other ad-hoc teams, in which trainees may find themselves in the next day. However, it remains unclear if that is indeed the case and whether and how the skills acquired in such simulations translate to clinical practice [21, 22]. Fortunately, clinical practice itself also provides many opportunities for real-life ad hoc teams to (further) refine their teamwork.

Several tools have been developed to guide feedback to resuscitation teams by scaffolding outside observations (e.g., [9, 23,24,25,26]). Post-resuscitation debriefing, for example, is recommended by resuscitation guidelines internationally [27, 28] to facilitate reflection upon teamwork as it has been associated with important patient outcomes such as return of spontaneous circulation and shorter no-flow time in cardiopulmonary resuscitation. The use of these tools requires, however, the presence of a trained observer, which poses both logistical and ethical challenges [29]. Because ad hoc teams, particularly in emergency care, can be needed at any time of any day, it is rarely feasible to ensure an observer’s availability. In addition, it may be ethically unacceptable to limit the outside expert’s role to observation if the team’s performance is less than optimal. Yet, prompt intervention would disturb both the team and the collection of information for later debriefing.

One potential way to inform debriefing that circumvents the logistical and ethical challenges is self-reflection of the team. Several frameworks for post-resuscitation debriefing exploit that possibility in that they ask the team to reflect on “what went well” and “what could have gone better”, for example [30]. Almost all emergency rooms (ERs) establish the role of a physician team leader in their resuscitation teams. Because most post-resuscitation debriefing frameworks call upon the physician team leader or the charge nurse to decide whether a debrief is required at all (e.g. [30]), the accuracy of their self-evaluation is of critical importance.

But are teams and their leaders accurate judges of their own teamwork? The literature on self-monitoring suggests so [31,32,33]: Although it has repeatedly been demonstrated that individuals’ self-assessments are low in accuracy [34, 35], people are much better able to self-monitor their current performance [31,32,33]. The key conceptual difference between self-assessment and self-monitoring is the timing of introspection: self-assessment refers to a summative overall self-evaluation detached from a single event (e.g., “How good a team player am I?”), whereas self-monitoring is a moment-to-moment assessment of one’s performance in a given situation (e.g., “How is our teamwork in this particular case?”) [35]. Self-monitoring is what prompts people to “slow down when they should” [33] or to look up a word when they are unsure of its meaning [35]. Self-reflection of team members before debriefing within a team directly after attending to a patient is conceptually closer to self-monitoring than to self-assessment, because the reflection refers to a single event in close temporal proximity, not an overall and aggregate judgement.

Based on this conception of self-monitoring, we hypothesize that the ability of both teams and their physician team leaders to self-monitor their teamwork directly after attending to a patient will be comparable to that of an external observer. Such an ability would justify relying on team members’ self-monitoring to inform debriefing in real-life teams, thus easing and facilitating training on the job.

Furthermore, we investigated whether the ratings of teamwork provided by the team, their leader and external observers are related to objective measures of performance that directly affect patient outcomes [36]. It is arguably only clinically meaningful and defensible to assess how well teams and their physician team leaders self-monitor their teamwork relative to an external observer if either the team’s self-monitoring judgements or the external observations are related to direct patient outcomes or measures of proven importance.

This quantitative observational study therefore addressed the following research questions:

  1. 1)

    How accurately do ad hoc resuscitation teams and their leaders monitor their teamwork relative to external observers’ rating of that teamwork?

  2. 2)

    How do teams’ self-monitoring judgements and external observations of their teamwork relate to objective performance measures?

Methods

We conducted an observational study of real-world interprofessional ad hoc teams responding to a simulated cardiac arrest in the emergency room. Teams consisting of residents, consultants, and nurses were confronted with an unexpected, simulated, standardized cardiac arrest situation. Their performance was videotaped to allow for subsequent external evaluation.

Participants, teams, and setting

The study was conducted in a single university-affiliated level-one emergency room attending to more than 50.000 patients annually [37]. All medical staff in this emergency room are required to attend an interprofessional training day once annually. Staff were assigned to one of 10 training days in their work schedule; participation in these trainings is mandatory. On each training day, participants were randomly assigned to one of four teams. Randomization was stratified by profession, so that each team included at least one physician and two nurses. Depending on training day attendance, some teams were larger than others, including up to three physicians and up to four nurses, reflecting team variability in clinical practice. The most senior physician in each team was appointed physician team leader upon team formation, reflecting clinical practice in the emergency room under investigation. We did not provide further instructions to physician team leaders because all participating physicians regularly fulfil this role in clinical practice, and we did not expect any differences between that role in the simulation and clinical practice.

Simulation and scenario

The 2019 interprofessional training day was designed as a rotation through different skill stations, where participants trained techniques such as intraosseous access, patient positioning, and paediatric advanced life support. Further, all teams rotated to a simulated shift handover, which was unexpectedly interrupted by a resuscitation call. Teams attended to this call as they would in reality; the simulation was designed as an in situ simulation and took place in the actual resuscitation bay of the emergency room.

In this resuscitation bay, teams were confronted with an elderly male patient on a stretcher (represented by a Leardal SimMan Essential patient simulator) under ongoing cardiopulmonary resuscitation (CPR) by paramedics. The paramedics reported to have initially encountered a conscious but helpless elderly patient in his flat. There, the patient was found lying on the floor after tripping over the sill of his balcony door 10 h previously when coming back inside from his balcony. He had fallen from body height and had been unable to alert help for an extended period up until a neighbour heard his calls for help. The paramedics found a hemodynamically stable, cold, and conscious but disoriented patient. They established a venous access and transferred the patient to the hospital uneventfully. Upon transfer from the ambulance onto the hospital’s stretcher just minutes prior, the patient had gone into cardiac arrest. The paramedics started CPR and alerted the ER staff.

The paramedics repeatedly informed the attending ER team that the patient’s flat was cold due to the balcony door being open and that the patient was cold as well. Paramedics had just initiated basic life support. Neither medication nor defibrillation had yet been provided. The paramedics then handed over resuscitation to the ERs team but remained available for further questions while they reorganized their material.

The patient simulator was programmed to exhibit a ventricular fibrillation and not to respond to resuscitative measures for the next 15 min. The team worked in its familiar emergency room environment with its usual equipment. Whenever a team member providing chest compressions was replaced, a study aid quietly informed them that their hands felt very cold due to the patient’s cold chest. This was necessary because the simulator used could not be programmed to feel cold. Whenever a team decided to take the patient’s temperature, the thermometer read 27.3 °C independent of the location of temperature measurement. All phone calls made by the team were answered by the simulation instructors, who responded with a standard response indicating that they would be available within a few minutes.

The simulation was wound up as soon as teams called for extracorporeal circulation (ECC) due to hypothermic arrest or ended by the instructor if teams had clearly made a different diagnosis of why the patient was in arrest. The whole scenario was intended to last less than 15 min. It was followed by a structured, instructor-led debriefing that included reviewing a video recording of the simulation. The debriefing was led by a trained and experienced simulation instructor and revolved around teamwork, team leadership and non-technical skills.

Ethics

The ethics committee of the Canton of Bern deemed the study to be exempt from full ethical review (Req-2017-00968) because it did not involve patients. All participants provided written informed consent for their data to be used in the study. As an incentive, all participants were entered in a lottery for the chance to win one of two tablet computers.

Measurement instruments

Participant questionnaires

All participants in the study independently answered two custom questionnaires. The first, which was administered prior to the simulation scenario, collected demographic information, data on participants’ professional experience, and information on their degree of acquaintance with the other team members. The data were collected as numbers (age, experience), through checkboxes (gender), or on 5-point Likert scales (acquaintance). The second questionnaire was completed individually directly after the simulation scenario and before debriefing. It assessed participants’ familiarity with the task (“Please indicate how familiar you are with cases like the one you just encountered.”) and their self-monitoring of their team’s teamwork (“Please indicate your confidence in the quality of your team’s teamwork.”) on 5-point Likert scales. It is generally assumed that the resulting confidence scores reflect the metacognitive feeling of fluency (see e.g., [38]). Previous research has shown a close relation of such confidence scores to other indicators of fluency, such as response time on diagnostic tasks [39] and the likelihood to change an initial answer in multiple choice tests [40].

Video recordings and choice of rating tool

All simulations were video recorded and recordings were evaluated by independent external expert raters, one psychologist (JF) and one emergency physician (WEH), both with extensive simulation experience. Their ratings were recorded using the Team Emergency Assessment Measure (TEAM) checklist [9]. In contrast to many other tools assessing teamwork (for a review, see [41]), TEAM has good psychometric properties such as a high interrater-reliability and high inter-item correlations, has been validated in several translated versions, and used in a variety of simulated and real-life resuscitation scenarios (for a review see [29]). In this study, we employed the German translation of the instrument [29].

The TEAM checklist is a previously published instrument that consists of 11 items assessing teamwork of medical emergency teams on 3 subscales: leadership (2 items), teamwork (7 items), and task management (2 items). All items are rated on a Likert scale ranging from 0 (never/hardly ever) to 4 (always/nearly always) and are then summarized into a sum score ranging between 0 and 44. In addition, teamwork is rated on a global rating scale (GRS) ranging from 1 (worst possible performance) to 10 (best possible performance). The GRS was worded as “Please provide an overall evaluation of the non-medical performance of this team.” Because a previous factor analysis [36] identified one underlying component accounting for 81% of the observed variation, with factor loadings > 0.6 and Eigenvalues > 1, it is defensible and common practice to summarize items of the TEAM into a sum score in the range between 0 and 44. The two expert raters each assessed 20% of the videos independently and in duplicate. As inter-rater agreement was good to excellent (intraclass correlation coefficient ICC = 0.87), the remaining videos were rated by a single rater.

We further extracted objective performance measures from the videos. In patients under resuscitation, such measures include early defibrillation and timing and number of doses of adrenaline administered [42], and implementation of extracorporeal circulation (ECC) in hypothermic cardiac arrest [43] and will be referred to as performance hereafter.

Data management and analysis

Questionnaire data were recorded on paper and entered into an excel sheet by an administrative assistant. 20% of the data entered were randomly selected and crosschecked by one of the authors (SCH). Videos were recorded using the AV system permanently installed in the resuscitation bay and stored on a secure network storage drive institutionally approved for storage of health related personal information. Video ratings and the extracted performance data such as time to first defibrillation were directly entered into a spreadsheet by expert raters. All data collected were then imported into an SPSS file. SPSS version 25 (IBM cooperation) was used for data analysis. Data are described using mean or median and standard deviation or range, as appropriate. We calculated Pearson’s correlations between the rater-based measures of teamwork (TEAM sum score and GRS) and participants’ self-evaluation of teamwork. We also correlated the rater-based measures of teamwork with team characteristics such as size, cumulative experience, and age of the team leader. Last, we assessed the relationship between TEAM sum scores or GRS and other behavioural data, such as time to first defibrillation. P values of less than 0.05 are considered significant.

Results

A total of 26 teams participated in the study. Two teams were excluded from the analysis because the videos were not recorded due to a technical failure. One team was excluded because two of its participants did not consent to study participation, and one team because the team contained a physician involved in this study. The analysis was thus based on 22 teams consisting of 115 health care professionals (22 physician team leaders and 93 team members). Participants were on average 36.7 years old and had a mean of 13.1 years’ professional experience, 6.3 years of those in emergency medicine; 77.4% were female (Table 1). Team leaders were on average 36.4 years old and had a mean of 9 years’ professional experience, 3.4 years of those in emergency medicine; 77.3% were female. Each team contained at least one physician (range 1–3, median 1) and two nurses (range 2–4, median 3); no team was smaller than 3 persons (range 3–6, median 4).

Table 1 Descriptive statistics
Full size table

The objectively observable performance of the teams was highly variable: On average, it took 8 min and 15 s (SD = 1:05 min) before teams called for ECC due to hypothermic arrest (n = 9) or the instructor ended the simulation (n = 13). Although all teams correctly recognized an arrest requiring early defibrillation, only half (n = 11) limited the number of attempted defibrillations, as is best practice in cases of hypothermic arrest. Time to defibrillation (mean = 1:06 min) and time to first adrenaline (mean = 3:31 min) was also highly variable across teams (Table 1). Two teams failed to administer adrenaline at all.

Teamwork quality as reflected by the external observations also varied greatly (Table 1). The TEAM sum score and the GRS were strongly correlated (rTEAM-GRS = 0.92, p < 0.001). Those teams with the highest scores on both scales were also the quickest to defibrillate and to provide adrenaline to the patient, providing further evidence for the concurrent validity of the TEAM measurement instrument (Table 2).

Table 2 Correlations of external observations, team characteristics and performance
Full size table

Team members’ self-monitoring judgements of their team’s teamwork were strongly correlated with both of the measures based on external observations (rTEAM_members-self = 0.573, p < 0.001, rGRS_members-self = 0.628, p < 0.001; Table 3). Interestingly, the same did not apply to the team leaders’ self-monitoring of their team’s teamwork (rTEAM_leader-self = 0.347, p = 0.145, rGRS_leader-self = 0.451, p = 0.052; Table 4).

Table 3 Correlations between self-monitoring, member characteristics and external observations
Full size table
Table 4 Correlations between self-monitoring, leader characteristics and external observations
Full size table

Neither team size, nor number of physicians per team, nor cumulative or average experience within a team was associated with the external observations. However, teams led by younger physicians achieved better teamwork scores from external observers than those led by older physicians (rTEAM_leader-age = − 0.461, p = 0.047, rGRS_leader-age = − 0.473, p = 0.041; Table 4).

Discussion

The performance of teams in this observational study of leadership in ad hoc teams attending to a simulated cardiac arrest with a rare cause varied greatly, with less than half of all teams making the correct diagnosis and calling for ECC. This variation should not be interpreted as a threat to the quality of actual care, because the whole idea of simulation-based training is to move participants out of their comfort zone to stimulate learning [44]. In fact, the rationale behind training for a hypothermic cardiac arrest was that this algorithm differs in important respects (e.g., dosing of adrenaline; frequency of defibrillation; early initiation of ECC) from standard advanced cardiac life support [43], and hypothermic arrests occur regularly (although infrequently) in our catchment area [37, 45, 46]. The scenario thus tested the team leader’s ability to lead the team through an algorithm that differs substantially from the much more common standard advanced cardiac life support [47], thus offering a potent opportunity for learning.

This heterogeneity in objective performance across teams is reflected in both, the external observation measures of video recordings and the teams’ self-monitoring, a finding that directly answers our second research question. The fact that objective performance measures of resuscitations correlate with scores on the TEAM checklist further validates this instrument for the assessment of resuscitation teams, a finding in line with previous research [9, 36]. It is interesting to note that the TEAM instrument assesses quality of teamwork, not quality of a resuscitation per se, but it seems that good teamwork is a prerequisite for good resuscitation [9, 36]. This finding, which we replicate, is reassuring, because arguably, the sole purpose of attending to patients in cardiac arrest with a team is to provide good resuscitation.

With regard to the first research question, we found moderately high agreement between the external observations and team members’ self-monitoring of their teams’ teamwork. These findings are well in line with the literature on self-monitoring of one’s individual performance on a moment-by-moment basis [31, 35, 39, 40, 48]. Our study extends this conception in two important ways. First, it indicates that the ability to accurately self-evaluate applies to both concurrent monitoring during an event and the time shortly after this event has concluded. Second, it suggests that individuals are capable of monitoring not only their own performance but also that of a team to which they belong. Interestingly, this finding does not hold for team leaders evaluating their team’s teamwork.

There are two possible explanations for the latter finding. One is that evaluating a team’s teamwork as a team member is a substantially different task than evaluating this team’s teamwork as the team leader. Every physician team leader carries the responsibility for their team’s teamwork, because arguably a key purpose of instituting a physician team leader is to ensure good teamwork in ad-hoc teams. Given the complexity of leadership [3, 10, 12, 13, 49], particularly in highly dynamic environments such as emergency rooms, leaders may be operating at their full capacity and lack the necessary mental resources for additional meta-cognitive tasks such as self-monitoring. The diffusion of responsibility observable even in small groups [50, 51] may also lead to this diffused responsibility being burdened on the team leader when teams institute such a function explicitly, resulting in further leader overload. It remains an open question whether this phenomenon also affects teams led by experienced non-physicians such as advanced practice nurses. Such nurses may be less tempted than physicians to focus on things other than teamwork in their role as team leaders. Also, nurses in emergency medicine often have considerably longer experience in the field than the physicians they work with. In this study, for example, team members (i.e., mostly nurses) had about twice as much experience in emergency medicine as physician team leaders. Although we cannot exclude that professional experience plays a role in the ability to self-monitor oneself, the literature on self-monitoring suggests otherwise (e.g. [39, 40]).

Another reason for that we did not observe adequate self-monitoring in team leaders may simply be the small sample size of just 22 team leaders. This sample may be too small to achieve significance when testing the likelihood of a correlation occurring by chance. However, we did find significant correlations between team performance and leaders’ age at this sample size. Sample size remains a notorious challenge in small group research [2], and this study is no exception.

Other limitations of this study result from its observational design, which was chosen to mimic real-world circumstances as closely as possible, but which rendered it impossible to control for and/or manipulate variables that may affect performance, such as team size, structure, or heterogeneity [52]. This limitation is, at the same time, one of the key strengths of the study: real-world ad hoc teams are also diverse with respect to all these variables and change on a frequent basis. The only such variable we found to affect teamwork was the age of the team leader. We can only speculate that this is because younger team leaders may have more recently received training on resuscitation guidelines, but this finding requires closer investigation. In addition, other factors that may affect teamwork such as institutional culture and environment were not varied between teams in this study, potentially limiting generalizability of our findings to environments substantially different from the one investigated here. Last, the simulation is limited by the fact that a hint was necessary to tell participants that their hands went cold during chest compression, because the simulator used cannot be programmed to feel cold.

Conclusion

Team members seem to have better insight into their teams’ teamwork than team leaders, as indicated by the moderately high correlation of their self-monitoring ratings with external ratings of their teamwork. As a practical consequence, the decision to debrief after a resuscitation and the debriefing itself should be informed by team members, not just leaders. External ratings of teamwork as recorded with the TEAM instrument were substantially correlated to objective measures of team performance, a finding that further adds to the validity of the TEAM assessment instrument.

Availability of data and materials

The datasets used and analysed during the current study are available from the corresponding author on reasonable request for researchers eligible to work with human data according to Swiss legislation. Eligibility will be determined by the ethics committee of the Canton Bern.

Abbreviations

ISS:

Injury Severity Score

ECC:

Extracorporeal circulation

TEAM:

Team Emergency Assessment Measure

GRS:

Global rating scale

ICC:

Intraclass correlation coefficient

ANP:

Advanced nurse practitioners

CRM:

Crew resource management

References

  1. Committee on Diagnostic Error in Health Care, Board on Health Care Services, Institute of Medicine, The National Academies of Sciences, Engineering, and Medicine. In: Balogh EP, Miller BT, Ball JR, editors. Improving Diagnosis in Health Care [Internet]. Washington, D.C: National Academies Press; 2015. [cited 2017 Dec 15]. Available from: http://www.nap.edu/catalog/21794.

    Google Scholar 

  2. Hautz WE, Kämmer JE, Exadaktylos A, Hautz SC. How thinking about groups is different from groupthink. Med Educ. 2017;51(2):229.

    Google Scholar 

  3. Tschan F, Semmer NK, Gautschi D, Hunziker P, Spychiger M, Marsch SU. Leading to recovery: group performance and coordinative activities in medical emergency driven groups. Hum Perform. 2006;19(3):277–304.

    Google Scholar 

  4. Tschan F, Semmer NK, Gurtner A, Bizzari L, Spychiger M, Breuer M, et al. Explicit reasoning, confirmation Bias, and illusory Transactive memory: a simulation study of group medical decision making. Small Group Res. 2009;40(3):271–300.

    Google Scholar 

  5. Williams KA, Rose WD, Simon R. Teamwork in emergency medical services. Air Med J. 1999;18(4):149–53.

    Google Scholar 

  6. Rosenman ED, Ilgen JS, Shandro JR, Harper AL, Fernandez R. A Systematic Review of Tools Used to Assess Team Leadership in Health Care Action Teams. Acad Med. 2015;90(10):1408–22.

    Google Scholar 

  7. Leonard M, Graham S, Bonacum D. The human factor: the critical importance ofeffective teamwork and communication in providing safe care. Qual Safe Health Care. 2004;13:i85–90.

    Google Scholar 

  8. Manser T. Teamwork and patient safety in dynamic domains of healthcare: a review of the literature: teamwork and patient safety. Acta Anaesthesiol Scand. 2009 Feb;53(2):143–51.

    Google Scholar 

  9. Cooper S, Cant R, Porter J, Sellick K, Somers G, Kinsman L, et al. Rating medical emergency teamwork performance: development of the TEAM emergency assessment measure (TEAM). Resuscitation. 2010;81(4):446–52.

    Google Scholar 

  10. Tiel Groenestege-Kreb D, van Maarseveen O, Leenen L. Trauma team. Br J Anaesth. 2014;113(2):258–65.

    Google Scholar 

  11. Saxena A, Desanghere L, Stobart K, Walker K. Goleman’s leadership styles at different hierarchical levels in medical education. BMC Med Educ. 2017;17(1):169.

    Google Scholar 

  12. Marks MA, Mathieu JE, Zaccaro SJ. A temporally based framework and taxonomy of team processes. Acad Manag Rev. 2001;26(3):356–76.

    Google Scholar 

  13. Ford K, Menchine M, Burner E, Arora S, Inaba K, Demetriades D, et al. Leadership and teamwork in trauma and resuscitation. West J Emerg Med. 2016;17(5):549–56.

    Google Scholar 

  14. Stroben F, Schröder T, Dannenberg KA, Thomas A, Exadaktylos A, Hautz WE. A simulated night shift in the emergency room increases students’ self-efficacy independent of role taking over during simulation. BMC Med Educ [Internet]. 2016;16(1) Available from: http://bmcmededuc.biomedcentral.com/articles/10.1186/s12909-016-0699-9, [cited 2016 Jul 19].

  15. Fernandez Castelao E, Boos M, Ringer C, Eich C, Russo SG. Effect of CRM team leader training on team performance and leadership behavior in simulated cardiac arrest scenarios: a prospective, randomized, controlled study. BMC Med Educ. 2015;15:116.

    Google Scholar 

  16. Ryan A, Rizwan R, Williams B, Benscoter A, Cooper DS, Iliopoulos I. Simulation training improves resuscitation team leadership skills of nurse practitioners. J Pediatr Health Care Off Publ Natl Assoc Pediatr Nurse Assoc Pract. 2019;33(3):280–7.

    Google Scholar 

  17. Rosenman ED, Vrablik MC, Brolliar SM, Chipman AK, Fernandez R. Targeted simulation-based leadership training for trauma team leaders. West J Emerg Med. 2019;20(3):520–6.

    Google Scholar 

  18. Buyck M, Manzano S, Haddad K, Moncousin A-C, Galetto-Lacour A, Blondon K, et al. Effects of blindfold on leadership in pediatric resuscitation simulation: a randomized trial. Front Pediatr. 2019;7:10.

    Google Scholar 

  19. Roberts NK, Williams RG, Schwind CJ, Sutyak JA, McDowell C, Griffen D, et al. The impact of brief team communication, leadership and team behavior training on ad hoc team performance in trauma care settings. Am J Surg. 2014;207(2):170–8.

    Google Scholar 

  20. Gross B, Rusin L, Kiesewetter J, Zottmann JM, Fischer MR, Prückner S, et al. Crew resource management training in healthcare: a systematic review of intervention design, training conditions and evaluation. BMJ Open. 2019 Feb;9(2):e025247.

    Google Scholar 

  21. Armenia S, Thangamathesvaran L, Caine A, King N, Kunac A, Merchant A. The role of high-Fidelity team-based simulation in acute care settings: a systematic review. Surg J. 2018;04(03):e136–51.

    Google Scholar 

  22. Miller D, Crandall C, Washington C, McLaughlin S. Improving teamwork and communication in trauma care through in situ simulations. Acad Emerg Med Off J Soc Acad Emerg Med. 2012;19(5):608–12.

    Google Scholar 

  23. Kim J, Neilipovitz D, Cardinal P, Chiu M, Clinch J. A pilot study using high-fidelity simulation to formally evaluate performance in the resuscitation of critically ill patients: the University of Ottawa critical care medicine, high-Fidelity simulation, and crisis resource management I study. Crit Care Med. 2006;34(8):2167–74.

    Google Scholar 

  24. Fletcher G, Flin R, McGeorge P, Glavin R, Maran N, Patey R. Anaesthetists’ non-technical skills (ANTS): evaluation of a behavioural marker system. Br J Anaesth. 2003;90(5):580–8.

    Google Scholar 

  25. Kolbe M, Burtscher MJ, Manser T. Co-ACT--a framework for observing coordination behaviour in acute care teams. BMJ Qual Saf. 2013;22(7):596–605.

    Google Scholar 

  26. DeMoor S, Abdel-Rehim S, Olmsted R, Myers JG, Parker-Raley J. Evaluating trauma team performance in a level I trauma center: validation of the trauma team communication assessment (TTCA-24). J Trauma Acute Care Surg. 2017;83(1):159–64.

    Google Scholar 

  27. Greif R, Lockey AS, Conaghan P, Lippert A, De Vries W, Monsieurs KG, et al. European resuscitation council guidelines for resuscitation 2015: section 10. Education and implementation of resuscitation. Resuscitation. 2015;95:288–301.

    Google Scholar 

  28. Morrison LJ, Neumar RW, Zimmerman JL, Link MS, Newby LK, McMullan PW, et al. Strategies for improving survival after in-hospital cardiac arrest in the United States: 2013 consensus recommendations: a consensus statement from the American Heart Association. Circulation. 2013;127(14):1538–63.

    Google Scholar 

  29. Freytag J, Stroben F, Hautz WE, Schauber SK, Kämmer JE. Rating the quality of teamwork-a comparison of novice and expert ratings using the TEAM emergency assessment measure (TEAM) in simulated emergencies. Scand J Trauma Resusc Emerg Med. 2019;27(1):12.

    Google Scholar 

  30. Mullan PC, Wuestner E, Kerr TD, Christopher DP, Patel B. Implementation of an in situ qualitative debriefing tool for resuscitations. Resuscitation. 2013;84(7):946–51.

    Google Scholar 

  31. McConnell MM, Regehr G, Wood TJ, Eva KW. Self-monitoring and its relationship to medical knowledge. Adv Health Sci Educ. 2012;17(3):311–23.

    Google Scholar 

  32. Tweed M, Purdie G, Wilkinson T. Low performing students have insightfulness when they reflect-in-action. Med Educ. 2017;51(3):316–23.

    Google Scholar 

  33. Moulton C, Regehr G, Lingard L, Merritt C, MacRae H. ‘Slowing down when you should’: initiators and influences of the transition from the routine to the effortful. J Gastrointest Surg. 2010;14(6):1019–26.

    Google Scholar 

  34. Davis DA, Mazmanian PE, Fordis M, Van Harrison R, Thorpe KE, Perrier L. Accuracy of physician self-assessment compared with observed measures of competence: a systematic review. JAMA. 2006;296(9):1094–102.

    Google Scholar 

  35. Eva KW, Regehr G. ‘I’ll never play professional football’ and other fallacies of self-assessment. J Contin Educ Heal Prof. 2008;28(1):14–9.

    Google Scholar 

  36. Cooper S, Cant R, Connell C, Sims L, Porter JE, Symmons M, et al. Measuring teamwork performance: validity testing of the TEAM emergency assessment measure (TEAM) with clinical resuscitation teams. Resuscitation. 2016;101:97–101.

    Google Scholar 

  37. Exadaktylos A, Hautz WE. Emergency medicine in Switzerland. ICU Manag Pract. 2015;15(4):160–2.

    Google Scholar 

  38. Oppenheimer DM. The secret life of fluency. Trends Cogn Sci. 2008;12(6):237–41.

    Google Scholar 

  39. Hautz WE, Schubert S, Schauber SK, Kunina-Habenicht O, Hautz SC, Kämmer JE, et al. Accuracy of self-monitoring: does experience, ability or case difficulty matter? Med Educ. 2019;53(7):735–44.

    Google Scholar 

  40. Kämmer JE, Hautz WE, März M. Self-monitoring accuracy does not increase throughout undergraduate medical education. Med Educ. 2020;54(4):320–7.

    Google Scholar 

  41. Valentine MA, Nembhard IM, Edmondson AC. Measuring teamwork in health care settings: a review of survey instruments. Med Care. 2014;1.

  42. Field JM, Hazinski MF, Sayre MR, Chameides L, Schexnayder SM, Hemphill R, et al. Part 1: Executive Summary: 2010 American Heart Association Guidelines for Cardiopulmonary Resuscitation and Emergency Cardiovascular Care. Circulation. 2010;122(18_suppl_3):S640–56.

    Google Scholar 

  43. Vanden Hoek TL, Morrison LJ, Shuster M, Donnino M, Sinz E, Lavonas EJ, et al. Part 12: Cardiac Arrest in Special Situations: 2010 American Heart Association Guidelines for Cardiopulmonary Resuscitation and Emergency Cardiovascular Care. Circulation. 2010;122(18_suppl_3):S829–61.

    Google Scholar 

  44. Meyer O. Simulators Don’t teach - Lernprozesse und Simulation. In: St. Pierre M, Breuer G, editors. Simulation in der Medizin [Internet]. Berlin, Heidelberg: Springer Berlin Heidelberg; 2013 [cited 2019 Aug 14]. Available from: http://link.springer.com/10.1007/978-3-642-29436-5.

  45. Mendonca M, Hautz WE, Schucht P, Reineke D, Kadner A, Lehmann B, et al. Extracorporeal life support in hypothermic cardiac arrest: reconsidering trauma as an absolute contraindication. Resuscitation. 2019;135:228–9.

    Google Scholar 

  46. Winkler B, Jenni HJ, Gygax E, Schnüriger B, Seidl C, Erdoes G, et al. Minimally invasive extracorporeal circulation resuscitation in hypothermic cardiac arrest. Perfusion. 2016;31(6):489–94.

    Google Scholar 

  47. Sauter TC, Iten N, Schwab PR, Hautz WE, Ricklin ME, Exadaktylos AK. Out-of-hospital cardiac arrests in Switzerland: Predictors for emergency department mortality in patients with ROSC or on-going CPR on admission to the emergency department. Schäfer A, editor. PLoS One. 2017;12(11):e0188180.

  48. Pusic MV, Chiaramonte R, Gladding S, Andrews JS, Pecaric MR, Boutis K. Accuracy of self-monitoring during learning of radiograph interpretation. Med Educ. 2015;49(8):838–46.

    Google Scholar 

  49. Härgestam M, Lindkvist M, Jacobsson M, Brulin C, Hultin M. Trauma teams and time to early management during in situ trauma team training. BMJ Open. 2016;6(1):e009911.

    Google Scholar 

  50. Aronson E, Wilson TD, Akert RM, Reiss M. Sozialpsychologie. 8., aktualisierte Auflage. Hallbergmoos: Pearson; 2014. p. 678. (ps Psychologie).

    Google Scholar 

  51. Darley JM, Latané B. Bystander intervention in emergencies: diffusion of responsibility. J Pers Soc Psychol. 1968;8(4):377–83.

    Google Scholar 

  52. Hautz WE, Hautz SC, Kämmer JE. Whether two heads are better than one is the wrong question (though sometimes they are). Adv Health Sci Educ Theory Pract. 2020;6.

Download references

Acknowledgements

We would like to thank all participants of the study, the team of simulation instructor at the Department of Emergency Medicine Inselspital University Hospital Bern and Susannah Goss for language editing the manuscript.

Funding

Departmental research funds of the Department of Emergency Medicine at Inselspital Bern University Hospital. JEK has received funding from the European Union’s Horizon 2020 research and innovation programme under the Marie Sklodowska-Curie grant agreement No. 894536 – “TeamUp”.

Author information

Authors and Affiliations

  1. Department of Emergency Medicine, Inselspital University Hospital Bern, Freiburgstrasse 16c, 3010, Bern, Switzerland

    Stefanie C. Hautz, Daniel L. Oberholzer, Aristomenis Exadaktylos, Juliane E. Kämmer, Thomas C. Sauter & Wolf E. Hautz

  2. Simulated Patient Program, Office of the Vice Dean for Teaching and Learning, Charité – Universitätsmedizin Berlin, corporate member of Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of Health, Charitéplatz 1, 10117, Berlin, Germany

    Julia Freytag

  3. Max Planck Institute for Human Development, Center for Adaptive Rationality (ARC), Lentzeallee 94, 14195, Berlin, Germany

    Juliane E. Kämmer

  4. Lernzentrum, Charité – Universitätsmedizin Berlin, Charitéplatz 1, 10117, Berlin, Germany

    Thomas C. Sauter

Authors
  1. Stefanie C. Hautz
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Daniel L. Oberholzer
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Julia Freytag
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Aristomenis Exadaktylos
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Juliane E. Kämmer
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Thomas C. Sauter
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Wolf E. Hautz
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

SCH, DLO, AE, TCS and WEH designed the study. SCH, DLO, and TCS collected the data, JF, JEK and WEH analysed the data, all authors interpreted the findings, SCH and WEH wrote the first version of the manuscript and all authors reviewed the manuscript and made revisions in important intellectual content. All authors read and approved the final version to be submitted for peer review.

Corresponding author

Correspondence to Wolf E. Hautz.

Ethics declarations

Ethics approval and consent to participate

The ethics committee of the Canton of Bern deemed the study to be exempt from full ethical review (Req-2017-00968) because it did not involve patients. All participants provided written informed consent for their data to be used in the study. As an incentive, all participants were entered in a lottery for the chance to win one of two tablet computers.

Consent for publication

Not applicable.

Competing interests

TCS has received research grants or lecture fees from Bayer, Boehringer Ingelheim, and Daiichi-Sankyo and the Gottfried and Julia Bangerter-Rhyner-Foundation. WEH has received speaker fees from the AO Foundation Zürich and research funding from Mundipharma Medical Basel. WEH is an associate editor at BMC Medical Education. All other authors have nothing to disclose.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hautz, S., Oberholzer, D., Freytag, J. et al. An observational study of self-monitoring in ad hoc health care teams. BMC Med Educ 20, 201 (2020). https://doi.org/10.1186/s12909-020-02115-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12909-020-02115-3

Keywords

BMC Medical Education

ISSN: 1472-6920

Contact us