Skip to main content

Table 3 Content Validity of Item Relevance for Part B of Questionnaire

From: The development and validation of the clinicians’ awareness towards cognitive errors (CATChES) in clinical decision making questionnaire tool

Item

N

A

PC

I-CVI

 

Evaluation of

Item no. 1

“Cognitive errors due to over-attachment to a particular diagnosis”

9

9

0.00195

1

1

Excellent

Item no. 2

“Cognitive errors due to failure to consider alternative diagnoses”

9

9

0.00195

1

1

Excellent

Item no. 3

“Cognitive errors due to inheriting someone else’s thinking”

9

9

0.00195

1

1

Excellent

Item no. 4

“Cognitive errors in prevalence perception or estimation”

9

8

0.01757

0.89

0.89

Excellent

Item no. 5

“Cognitive errors involving patient characteristics or presentation context”

9

9

0.00195

1

1

Excellent

Item no. 6

“Cognitive errors that are associated with the doctor’s affect or personality”

9

9

0.00195

1

1

Excellent

  1. Pc is the probability of chance of occurrence. The formula for Pc is: N!/[A!*(N-A)!]*0.5N where N the number of judges, A the number agreeing on good relevance. I-CVI is A/N
  2. The formula for modified kappa statistic () = (I-CVI – pc)/(1 – pc), where Pc represents probability of a chance occurrence (Polit et al. [16])
  3. Evaluation criteria for modified kappa (): = fair (0.40–0.59), = good (0.60–0.74) and = excellent (>0.74)
  4. CVI should be 0.85 and above (Lynn 1986) to establish validity with a p < 0.05