Table 3 Messick framework: sources of evidence, definitions and procedure
Source of evidence | Definition | Procedure |
|---|---|---|
Content | “the relationship between a test's content and the construct it is intended to measure [26].” | Assessed as a part of development |
Internal structure | "The relationship among data items within the assessment and how these relate to the overarching construct [24]" | Interrater reliability |
Internal consistency | ||
Observability | ||
Relationships with other variables | “The degree to which these relationships are consistent with the construct underlying the proposed test score interpretations [26]” | Planned in further validations |
Response process | “The fit between the construct and the detailed nature of performance... actually engaged in [26]” | Raters respond in questionnaire |
Consequences | “The impact, beneficial or harmful and intended or unintended, of assessment [27]” | Evaluation of the possibility of minimal rater training |