Table 1 Variation in original methods, data collected and statistical analysis for ANTS, Oxford NOTECHS and OSCAR

ANTS – for assessment of an anesthetist only

50 anesthesiologists trained, new to NTS rating, each rated 8, non-standardized videos of simulated anesthetic scenarios

All elements [15] and category [4] scores, no global score.

Accuracy of scores with percent agreement (± 1 scale point) to reference ratings and mean absolute difference IRR with r_WG

Oxford NOTECHS - for assessment of three theatre teams – surgical, anesthesia and nursing

6 assessors (3 clinical, 3 human factors experts) assessed a total of 297 live surgical procedures in pairs (surgeon and human factors expert)

Total scores for categories in sub-teams and overall summated score (for all categories and all teams)

Differences in mean scores, IRR with ICC for global and category scores

OSCAR - for assessment of a resuscitation team in the following groups: anesthesia, physician and nursing groups

2 clinical expert assessors, each rated 8, non-standardized videos of simulated cardiac arrest scenarios

Scores for each element, overall category score and a summated global score

Descriptive statistics to explore mean scores between raters, IRR with ICC for global and category scores