Table 2 Examiner responses to questionnaire
Item Name | Strongly Disagree | Disagree | Neither Agree nor Disagree | Agree | Strongly Agree |
|---|---|---|---|---|---|
1. For the video consultations that I viewed, there was generally sufficient information available for me to make a judgement of the candidates’ data gathering | 1 0.55% | 12 6.59% | 16 8.79% | 123 67.58% | 30 16.48% |
2. For the video consultations that I viewed, there was generally sufficient information available for me to make a judgement of the candidates’ clinical management | 2 1.10% | 9 4.95% | 30 16.48% | 118 64.84% | 23 12.64% |
3. For the video consultations that I viewed, there was generally sufficient information available for me to make a judgement of the candidates’ interpersonal skills | 0 | 4 2.20% | 8 4.40% | 118 64.84% | 52 28.57% |
4.a. For the audio consultations that I viewed, there was generally sufficient information available for me to make a judgement of the candidates’ data gathering | 1 0.57% | 10 5.75% | 15 8.62% | 123 70.69% | 25 14.37% |
4.b. For the audio consultations that I viewed, there was generally sufficient information available for me to make a judgement of the candidates’ clinical management | 2 1.15% | 16 9.20% | 32 18.39% | 108 62.07% | 16 9.20% |
4.c. For the audio consultations that I viewed, there was generally sufficient information available for me to make a judgement of the candidates’ interpersonal skills | 2 1.15% | 16 9.20% | 32 18.39% | 108 62.07% | 16 9.20% |
5. The content of the consultations I viewed was not representative of the work of a typical GP during the COVID-19 pandemicb | 32 17.58% | 100 54.95% | 31 17.03% | 15 8.24% | 4 2.20% |
6. The content of the consultations I viewed represented a good sample across the curriculum | 5 2.75% | 52 28.57% | 39 21.43% | 78 42.86% | 8 4.40% |
7. My level of confidence in the judgements I made compared to examining in the CSA is:a | 3 1.65% | 66 36.26% | 104 57.14% | 8 4.40% | 1 0.55% |
8. It was difficult to use the 3-point borderline standard setting judgementb | 23 12.57% | 102 55.74% | 36 19.67% | 20 10.93% | 2 1.09% |
9. It was easy to use the 5-point standard setting system. | 4 2.19% | 29 15.85% | 32 17.49% | 94 51.37% | 24 13.11% |
10. The Hofstee standard setting questions were easy to answer. | 27 14.84% | 54 29.67% | 58 31.87% | 37 20.33% | 6 3.30% |
11. It was easy to view, assess and feedback using the FourteenFish platform. | 1 0.55% | 4 2.20% | 4 2.20% | 55 30.22% | 118 64.84% |
12. The morning briefing meeting was helpful. | 2 1.10% | 11 6.04% | 28 15.38% | 108 59.34% | 33 18.13% |
13. The RCA examiner training was helpful in preparing me for the examination. | 0 | 4 2.20% | 8 4.40% | 81 44.51% | 89 48.90% |
14. The marshal was accessible during the day. | 0 | 2 1.09% | 15 8.20% | 67 36.61% | 99 54.10% |
15. I felt supported by the marshal with I.T/recorded consultation issues. | 1 0.55% | 1 0.55% | 43 23.63% | 63 34.62% | 74 40.66% |
16. Queries/incidents were dealt with in a timely manner by the marshal. | 0 | 3 1.65% | 37 20.33% | 56 30.77% | 86 47.25% |
17. Reminders by the marshal for the submission of marks were a useful prompt. | 2 1.09% | 13 7.10% | 106 57.92% | 45 24.59% | 17 9.29% |