Table 4 Evaluation outcomes according to Barr et al.’s modified Kirkpatrick typology

1: Reaction

Participants’ experiences of, or satisfaction with the research education program

[29, 32,33,34, 39,40,41,42,43,44,45, 47, 49, 51, 52, 54, 57, 58, 61, 66, 69, 73, 74, 78, 84, 87, 91]

2a: Attitudes toward research

Participants’ self-reported changes in research attitudes

[33, 36, 40, 41, 43, 45, 46, 55, 62, 68, 69, 71, 75, 80, 89, 100, 102]

2b: Knowledge, skills, or confidence

Self-reported changes in research knowledge, skills, or confidence

Objective measures of research knowledge or skills

[9, 31, 36,37,38,39,40,41,42,43,44, 46, 47, 50,51,52,53, 55, 56, 58, 59, 61, 63,64,65, 67, 69,70,71, 75, 79, 81, 82, 84, 86, 87, 89,90,91, 93, 102]

[30, 38, 48, 56, 63, 65, 66, 69,70,71, 102]

3: Behaviour

Self-reported changes in research activity / behaviour

Observed behaviours / research outputs (e.g., protocols, manuscripts, conference presentations, grants)

[30, 34, 38, 53, 54, 56, 62, 66, 69, 71, 74, 75, 77, 80, 81, 84, 85, 88, 93, 100, 102]

[31, 34, 35, 46, 48, 59, 64, 73, 74, 78, 87, 90,91,92, 94]

4a: Organisational culture or practice

Changes in organisational research culture or practice (e.g., new research infrastructure, networks, or impact on program participants’ colleagues / teams)

[37, 38, 50, 55, 58, 60, 69, 79, 90, 100]

4b: Health consumer outcomes

None reported

Not applicable