Skip to main content

Table 2 Test-retest and inter-rater reliability of the K-REC instrument

From: Development and psychometric testing of an instrument to evaluate cognitive skills of evidence based practice in student health professionals

Item no. and content assessed Test-retest reliability Inter-rater reliability
1 Research question (PICO) 100% 100%
2 Sources of information K 0.91 (0.85 - 0.97) K 1.00
3 Study design knowledge 100% 96%
4 Search strategy (MeSH) K 0.93 (0.79 - 1.00) K 1.00
5 Search strategy (Boolean) K 0.77 (0.54 - 1.00) K 0.83 (0.44 - 1.22)
6 Critical appraisal K 0.71 (0.32 - 1.00) K 1.00
7 Critical appraisal ICC 0.80 ICC 0.87
8a Research evidence statistics K 0.86 (0.68 - 1.00) K 1.00
8b Research evidence statistics K 0.94 (0.82 - 1.00) K 1.00
9 Levels of evidence K 0.62 (0.32 - 0.92) K 1.00
K-REC total scores ICC 0.88 ICC 0.97
  1. ICC Intraclass correlation coefficient, K Cohen's Kappa coefficient (95% confidence interval), MeSH Medical subject headings, PICO (Participants, Intervention, Control or Comparator, Outcome)