|
Conduct of the standard setting
|
Conducted with all panel members in person
|
4
|
1
|
1
|
1
|
7
|
|
Conducted electronically
|
2
|
1
|
0
|
0
|
3
|
|
Calibration session held
|
3
|
0
|
0
|
0
|
3
|
|
No Calibration
|
3
|
2
|
1
|
1
|
7
|
|
Answers to question provided to panel members
|
4
|
2
|
0
|
1
|
7
|
|
No answers provided
|
2
|
0
|
1
|
0
|
3
|
|
Performance data shown to panel member
|
2
|
0
|
0
|
0
|
2
|
|
No performance data provided
|
4
|
2
|
1
|
1
|
8
|
|
Ratings discussed and changes allowed
|
2
|
2
|
1
|
1
|
6
|
|
Consensus decision
|
2
|
0
|
0
|
0
|
2
|
|
No discussion or change allowed
|
2
|
0
|
0
|
0
|
2
|
|
Analysis of standard setting data
|
Standard set the whole exam
|
5
|
2
|
1
|
1
|
9
|
|
Standard set a random selection
|
1
|
0
|
0
|
0
|
1
|
|
Used the Mean across all panel members
|
3
|
2
|
1
|
0
|
6
|
|
Used the Median across all panel members
|
1
|
0
|
0
|
1
|
2
|
|
N/A Consensus used
|
2
|
0
|
0
|
0
|
2
|
|
Does not add a measurement error to the cut score
|
5
|
2
|
1
|
0
|
8
|
|
Measurement error added to the cut score
|
1
|
0
|
0
|
1
|
2
|
|
Standard setting mark used as the cut score
|
5
|
2
|
1
|
1
|
9
|
|
Standard setting mark used as a guide only
|
1
|
0
|
0
|
0
|
1
|
|
TOTAL SCHOOLS
|
6
|
2
|
1
|
1
|
10
|
