Skip to main content

Table 3 Intra-Panelist κ Coefficient Values for Each Method

From: Comparison of the validity of bookmark and Angoff standard setting methods in medical performance tests

Rater Round Angoff bookmark
1st 2nd 1st 2nd
r1 2nd 0.64   0.70  
Final 0.70 0.75 0.80 0.90
r2 2nd 0.69   0.80  
Final 0.70 0.74 0.90 1.00
r3 2nd 0.70   0.79  
Final 0.74 0.79 0.84 0.96
r4 2nd 0.78   0.85  
Final 0.85 0.88 0.78 0.80
r5 2nd 0.75   0.80  
Final 0.78 0.81 0.88 0.95
r6 2nd 0.76   0.84  
Final 0.76 0.83 0.89 0.90
r7 2nd 0.64   0.81  
Final 0.61 0.65 0.89 1.00
r8 2nd 0.48   0.85  
Final 0.52 0.60 0.92 1.00
r9 2nd 0.49   0.90  
Final 0.57 0.58 1.000 1.00
r10 2nd 0.45   0.87  
Final 0.48 0.60 0.77 0.90
r11 2nd 0.60   0.80  
Final 0.63 0.67 1.00 0.97
r12 2nd 0.47   
Final 0.49 0.60