Table 2 The final Modified MERSQI; items after Deplhi-1, scores after Delphi-2

Study design

1. Study design: (Pls. select one)

a. Single group cross-sectional or single group post-test only

7

23

b. Single group pre-test & post-test

9

c. Nonrandomised, 2 groups

10

d. Randomised controlled trial with high risk bias^a

11

e. Randomised controlled trial with moderate risk bias^a

16

f. Randomised controlled trial with low risk bias^a

23

Sampling

2. Is there a power calculation (sufficient statistical power) for sample size?

10

a. No

0

b. Yes

3

3. Are detailed participant characteristics for each arm reported?

a. No

0

b. Yes

3

4. Response rate, %: (Pls. select one)

a. Not reported

0.5

b. < 50

1

c. 50‐74

2

d. > 75

4

Setting

5. Institutions studied: (Pls. select one)

8

a. Single centre

5

b. Multi centre no further specification

5

c. Multi centre with specification but not appropriate / balanced / complementary

5

d. Multi centre with appropriate and balanced / complementary

8

Type of data

6. Type of data

11

Assessment by participants

4

Objective measurement (Pls. select one)

a. Knowledge test (e.g. recall type questions)

6

b. Applied knowledge test (e.g. analysis and problem-solving type questions)

8

c. Skills

11

Validity of evaluation instrument

7. Internal structure:

15

a. Not applicable

b. Not reported

0

c. Reported

5

8. Content:

a. Not applicable

b. Not reported

0

c. Reported

5

9. Relationships to other variables:

a. Not applicable

b. Not reported

0

a. Reported

5

Data analysis

10. Appropriateness of analysis:

17

a. Inappropriate for study design or type of data

0

b. Appropriate for study design, type of data

9

11. Complexity of analysis (if appropriate for study design): (Pls. select one)

a. Descriptive analysis only

4

b. Simple inferential statistics

4

c. Modelling and more complex analysis

8

Outcomes

12. Outcomes

Satisfaction, attitudes, perceptions, opinions, general facts

7

16

Knowledge, measured by: (Pls. select one)

a. Low fidelity simulation or paper-based assessments

9

b. High fidelity simulation

12

Skills measured by:

a. Low fidelity simulation or paper-based assessments

8

b. High fidelity simulation

12

Behaviours in clinical environment

13

Patient/health care outcome

16

Total Possible score

Min 23.5

Max 100