Table 1 Showing original MERSQI and first Modification of the MERSQI, showing the new items used in Delphi-1

1. Study design

Study design

1. Study design

Single group cross-sectional or single group post-test only

a. Single group cross-sectional or single group post-test only

Single group pre-test & post-test

b. Single group pre-test & post-test

Nonrandomized, 2 groups

c. Nonrandomised, 2 groups

Randomized controlled trial

d. Randomised controlled trial with high risk bias^a

e. Randomised controlled trial with moderate risk bias^a

f. Randomised controlled trial with low risk bias^a

2. Institutions studied: (Pls. select one)

Sampling

1. Is there a power calculation for sample size?

1

2. Are detailed participant characteristics for each arm reported?

2

3. Response rate, %: (Pls. select one)

 > 2

3. Response rate, %: (Pls. select one)

Not applicable

a. Not applicable

 < 50 or not reported

b. < 50 or not reported

50‐74

c. 50‐74

 > 75

d. > 75

Setting

4. Institutions studied: (Pls. select one)

a. Single centre

b. Multi centre

4. Type of data

Type of data

5. Type of data

Assessment by participants

Assessment by participants

Objective measurement

Objective measurement (Pls. select one)

a. Knowledge test (e.g. recall type questions)

b. Applied knowledge test (e.g. analysis and problem-solving type questions)

c. Skills

5. Internal structure:

Validity of evaluation instrument

6. Internal structure:

a. Not applicable

a. Not applicable

b. Not reported

b. Not reported

c. Reported

c. Reported

6. Content:

7. Content:

a. Not applicable

a. Not applicable

b. Not reported

b. Not reported

c. Reported

c. Reported

7. Relationships to other variables:

8. Relationships to other variables:

a. Not applicable

a. Not applicable

b. Not reported

b. Not reported

c. Reported

c. Reported

8. Appropriateness of analysis:

Data analysis

9. Appropriateness of analysis:

a. Inappropriate for study design or type of data

a. Inappropriate for study design or type of data

b. Appropriate for study design, type of data

b. Appropriate for study design, type of data

9. Complexity of analysis:

10. Complexity of analysis: (Pls. select one)

a. Descriptive analysis only

a. Descriptive analysis only

b. Beyond descriptive analysis

b. Simple inferential statistics

c. Modelling and more complex analysis

10. Outcomes

Outcomes

11. Outcomes

Satisfaction, attitudes, perceptions, opinions, general facts

Satisfaction, attitudes, perceptions, opinions, general facts

Knowledge, skills

Knowledge, skills measured by: (Pls. select one)

Behaviours

a. Low fidelity simulation or paper-based assessments

Patient/health care outcome

b. High fidelity simulation

Behaviours in clinical environment

Patient/health care outcome