Table 2 Test-retest and inter-rater reliability of the K-REC instrument
Item no. and content assessed | Test-retest reliability | Inter-rater reliability |
|---|---|---|
1 Research question (PICO) | 100% | 100% |
2 Sources of information | K 0.91 (0.85 - 0.97) | K 1.00 |
3 Study design knowledge | 100% | 96% |
4 Search strategy (MeSH) | K 0.93 (0.79 - 1.00) | K 1.00 |
5 Search strategy (Boolean) | K 0.77 (0.54 - 1.00) | K 0.83 (0.44 - 1.22) |
6 Critical appraisal | K 0.71 (0.32 - 1.00) | K 1.00 |
7 Critical appraisal | ICC 0.80 | ICC 0.87 |
8a Research evidence statistics | K 0.86 (0.68 - 1.00) | K 1.00 |
8b Research evidence statistics | K 0.94 (0.82 - 1.00) | K 1.00 |
9 Levels of evidence | K 0.62 (0.32 - 0.92) | K 1.00 |
K-REC total scores | ICC 0.88 | ICC 0.97 |