Skip to main content

Comparison of the effects of apprenticeship training by sandwich feedback and traditional methods on final-semester operating room technology students’ perioperative competence and performance: a randomized, controlled trial

Abstract

Background

Effective feedback is fundamental in clinical education, as it allows trainers to constantly diagnose the trainees’ condition, determine their weaknesses, and intervene at proper times. Recently, different feedback-based approaches have been introduced in clinical training; however, the effectiveness of such interventions still needs to be studied extensively, especially in the perioperative field. Therefore, this study sought to compare the effects of apprenticeship training using sandwich feedback and traditional methods on the perioperative competence and performance of Operating Room (OR) technology students.

Methods

Thirty final-semester undergraduate OR technology students taking the apprenticeship courses were randomly allocated into experimental (n = 15) and control (n = 15) groups through the stratified randomization approach. The students in the experimental group experienced Feedback-Based Learning (FBL) using a sandwich model, and the students in the control group participated in Traditional-Based Training (TBT) in six five-hour sessions weekly for three consecutive weeks. All students completed the Persian version of the Perceived Perioperative Competence Scale-Revised (PPCS-R) on the first and last days of interventions. Also, a blinded rater completed a checklist to evaluate all students’ performance via Direct Observation of Procedural Skills (DOPS) on the last intervention day. Besides, the students in the FBL filled out a questionnaire regarding their attitude toward the implemented program.

Results

The mean total score of the PPCS-R was significantly higher in the FBL than in the TBT on the last intervention day (P < 0.001). Additionally, the increase in mean change of PPCS-R total score from the first to last days was significantly more in the FBL (P < 0.001). Likewise, the FBL students had higher DOPS scores than the TBT ones (P < 0.001). Most FBL students also had a good attitude toward the implemented program (n = 8; 53.3%).

Conclusion

Apprenticeship training using a sandwich feedback-based approach was superior to the traditional method for enhancing perioperative competence and performance of final-semester OR technology students. Additional studies are required to identify the sustainability of the findings.

Peer Review reports

Background

A substantial concern in perioperative training is how trainees develop their technical or procedural skills and improve their performance and the required competencies for safe perioperative care and treatment [1]. Currently, most perioperative training programs are presented through apprenticeship courses in the Operating Room (OR), where most trainees encounter a high stress level as they are subjected to time pressures by the OR staff, making them susceptible to clinical errors [2]. In addition, due to restrictions on perioperative trainees’ work hours and trainers’ time, OR trainees confront challenges concerning traditional apprenticeship methods, such as being evaluated by inappropriate assessment methods and a lack of receiving constructive feedback on their educational endeavors [3, 4].

The OR program in Iran, a new four‑year centralized program called “OR technology”, lacks a well-designed or evidence-based approach to apprenticeship training, which may result in trainees’ failure to obtain the required skills and competencies [5]. However, considering the ever-increasing expectations of quality care in Iran, the emphasis of OR training in this country has been on trainees’ procedural skills and qualifications [6]. Based on the Iranian OR curriculum, most apprenticeship courses are trained with traditional methods, in which a faculty member, clinical instructor, or nurse manager supervises trainees in an actual OR when they act as technologists in specialized and sub‑specialized surgeries in two roles of a scrub or circulating person [7]. Besides, assessing OR trainees’ perioperative skills and competencies is a demanding issue in Iranian OR clinical courses because it is usually limited to traditional methods concentrated on subjectivity in assessment [8]. Hence, the perioperative competencies and procedural skills evaluation also has been criticized in Iranian traditional perioperative apprenticeship training as it is commonly summative, arbitrary, or subjective, without providing appropriate, purposeful, and structured formative feedback [9]. Consequently, it is indispensable to change or complement the traditional perioperative apprenticeship methods with new practical and well-established approaches to cultivate the required perioperative competencies and performance of Iranian OR trainees. To this end, there is a growing interest in Iranian perioperative studies to establish active and productive clinical training methods for OR trainees [10,11,12,13].

One of the fundamental components of higher education is feedback, allowing trainers to constantly diagnose the trainees’ condition, determine their weaknesses, and intervene at proper times [14]. Also, formative feedback is a highly influential factor in improving trainees’ learning performance because it helps them to identify and correct their mistakes in the learning process and carry out assigned tasks more precisely [15]. On the contrary, in the summative feedback commonly provided in the traditional training methods, in which the trainers inspect the trainees’ status at the end of the semester, trainees can experience ever-increasing knowledge gaps until they relinquish their control [14].

Recently, numerous models and approaches have been used by clinical trainers to plan effective feedback encounters, including the SET-GO model, the One-Minute Preceptor, the Pendleton Rules, the R2C2 (Rapport/Reaction/Content/Coach), and the ALOBA (Agenda Led Outcome-based Analysis) [16]. Another type of the most commonly identified feedback is a sequence of positive-corrective-positive statements known as sandwich feedback [17]. In this approach, first represented by LeBaron and Jernick in 2000, one dose of critical/corrective feedback sandwiches between two doses of positive/reinforcement feedback such that the first and last statements are positive [18]. Sandwich feedback is a well-structured model that needs low levels of feedback-giving expertise by the trainer and low self-assessment and reflection skills by the trainee, making it useful in different feedback encounters [16].

Although feedback based on trainees’ perioperative performance seems to be associated with improving their performance, there is a paucity of research in this area worldwide [4]. Given this reason, and since proper feedback on students’ educational endeavors is often overlooked in ordinary apprenticeship training and evaluation in Iran’s OR program, we sought to compare the impacts of Feedback-Based Learning (FBL) presented based on the sandwich approach following the Direct Observation of Procedural Skills (DOPS) to the Traditional-Based Training (TBT) on improving perioperative competence and performance of Iranian OR technology students. We hypothesized that, after the interventions, the perioperative competence of students who experienced FBL would be higher than those who received TBT. Also, we assumed that the FBL arm’s perioperative performance would be better than the TBT arm at the end of the training. Finally, after participating in the FBL program, we deemed that students would have a moderate-to-good attitude toward FBL.

Methods

Study design

This was a quasi-experimental study with a parallel group design of 30 final-semester OR technology students enrolled during their field apprenticeship courses in the second semester of the academic year 2022–2023. The study was reported according to the Guideline for Reporting Evidence-based Practice Educational Interventions and Teaching (GREET) [19].

Course background

The Iranian four-year Bachelor of Science (BS) program in OR technology comprises 130 units (i.e., 22 general, 74 basic sciences and core, 18 clinical training, and 16 field apprenticeship). Students start their clinical training in the second semester, running concurrently with theoretical courses until the end of the sixth semester. In the seventh and eighth semesters, students only present in the OR to pass their field apprenticeship courses, which is mandatory to reach a BS degree [7]. During the field apprenticeship program, students will act as OR technologists in specialized and sub-specialized surgeries in two roles, a circulating person and a scrub person, under the supervision of expert staff or faculty members. At the end of each semester of field apprenticeship, students’ procedural skills and competencies will be evaluated as subjective or objective [6].

Participants and setting

The participants were all OR technology students who experienced the field apprenticeship courses in their last semester of an eight-semester BS program at two educational hospitals affiliated with Qom University of Medical Sciences, Qom, Iran. The students who were guests from other universities and those absent for more than three sessions during the three weeks of the intervention were excluded. Also, the students who had any experience of clinical working in the OR outside of their school program were withdrawn from the study.

The eligible students were recruited via the census. Of the 30 eligible students, all voluntarily accepted to partake in the study. Stratified randomization was used to divide students into TBT (n = 15) and FBL (n = 15). To this end, first, recruitment hospitals and gender were considered potential covariates, and four stratifications were generated (i.e., first hospital and male, first hospital and female, second hospital and male, second hospital and female). Then, each student was given a number from 1 to 30 and allocated to an appropriate combination of generated stratifications. Finally, students of each combination of stratifications were assigned equally to the study groups utilizing a random number software.

Data collection tools

Data were collected with a demographic-educational information form, the Persian version of the Perceived Perioperative Competence Scale-Revised (PPCS-R), the checklist of DOPS for OR technology students, and the FBL attitude questionnaire. The first tool includes information on students’ age, gender, recruited hospital, and the previous semester’s grade point average; all documented before group allocation. The PPCS-R was filled out by all students on the first and last days of three-week interventions to measure their perioperative competence as pre-test and post-test. However, the DOPS checklist was completed only on the last day of the three-week intervention to assess students’ perioperative performance during DOPS. To control the rater’s bias, the DOPS checklist was completed for all students by a blinded rater with good experience in performing DOPS, who was unfamiliar with the recruited students and unaware of their assigned groups. The DOPS checklist was also fulfilled during DOPS by an OR instructor for the FBL students as a part of the feedback-based strategy. The FBL attitude questionnaire was also completed on the last day of the three-week intervention by FBL students to measure their attitude regarding the implemented program. Additionally, the FBL instructors’s perspectives regarding the implemented program were narrated to better understand the program’s value.

The PPCS-R is a self-completed tool developed by Mirbagher Ajorpaz et al. (2016) to assess the clinical competence of final-semester OR technology students in their apprenticeship courses. The scale contains 33 items on a five-point Likert scale from strongly disagree (score: 1) to strongly agree (score: 5). The scale also has five dimensions: (1) “foundational skills and knowledge” (seven items), (2) “leadership” (nine items), (3) “collegiality” (seven items), (4) “proficiency” (four items), and (5) “professional development” (six items). The scale total score, varying from 33 to 165, is computed by summing up the scores of five dimensions. A higher score demonstrates a higher level of clinical competence. A good fit to the data was reported in the first psychometric assessment of this scale in the Iranian context (goodness of fit index = 0.86, adjusted goodness of fit index = 0.90, comparative fit index = 0.90, normed fit index = 0.84, and root mean square error of approximation = 0.04). The internal consistency was also established by obtaining Cronbach’s alpha (α) of 0.86 for the entire scale and 0.62 to 0.70 for five dimensions [20]. In the current study, we obtained a Cronbach’s alpha of 0.74 for the entire scale, using data gathered in the pre-test.

The DOPS checklist for OR technology students was developed by Nayyeri et al. (2021) to evaluate the common technical-surgical skills of Iranian final-semester OR technology students via DOPS. The checklist includes the following eight domains (one question per domain), which could be assessed in all educational hospitals for all students: (1) “information about the anatomy of the surgical site”, (2) “communication with the patient”, (3) “pre-operative measures”, (4) “compliance with sterile conditions”, (5) “technical skills in surgery”, (6) “post-operative measures”, (7) “communication with the members of the surgical team”, and (8) “professional behavior”. Each question is scored on a five-point Likert scale, including unobservable (score: 1), less than expected (score: 2), borderline (score: 3), as expected (score: 4), and more than expected (score: 5). The checklist total score ranges from 8 to 40, and a higher score displays a better level of perioperative performance. Nayyeri et al. confirmed the validity and test-retest reliability of the DOPS checklist with a Content Validity Index (CVI) of 0.80 and the Intraclass Correlation Coefficient (ICC) of 0.93, respectively. They also reported good internal consistency with a Cronbach’s alpha of 0.90 [21]. We obtained a Cronbach’s alpha of 0.88 for internal consistency in the current study. Also, to establish the inter-rater reliability, 30 students with similar educational characteristics to those of the target population were evaluated by two raters, and the ICC coefficient for raters agreement was found to be 0.76.

The FBL attitude questionnaire was designed by Ghilay (2018) to examine students’ views towards the FBL model in higher education. This self-report questionnaire includes 19 items on a five-point Likert scale from strongly disagree (score: 1) to strongly agree (score: 5). The questionnaire consists of four dimensions: (1) “diagnosis” (i.e., identifying learning difficulties, four items, α = 0.88), (2) “prognosis” (i.e., management of problems, seven items, α = 0.94), (3) “motivation and sense of belonging” (four items, α = 0.80), and (4) “the contribution of FBL to learning improvement” (four items, α = 0.90). The total questionnaire score varies from 19 to 95, with higher obtained scores describing better attitudes [14].

The FBL attitude questionnaire in the current study was translated from English to Persian with a forward-backward technique while preserving its original content. Then, the validity and reliability of the Persian version were assessed. To address content validity, 12 medical education professionals with experience in testing the psychometry properties of educational tools were invited purposively. In the first stage, they investigated the questionnaire qualitatively regarding objectivity, the number of items, and the logical sequence of items. Subsequently, based on the experts’ feedback, the questionnaire was revised and sent back to them to evaluate the 19 modified items regarding quantitative content validity. The experts determined all items as relevant and essential, indicating a minimum Item-level Content Validity Index (I-CVI) of 0.97 and the Content Validity Ratio (CVR) of 0.88, which are satisfactory [22]. Besides, the qualitative face validity of the final Persian version was established in terms of difficulty, ambiguity, and syntax by 30 students with identical features to those of the target population, who were chosen purposively and not incorporated in the principal analysis. Also, the questionnaire’s internal consistency was reasonable, as it obtained 0.87 by Cronbach’s alpha for the entire tool. According to the statistical adviser, the total score of the questionnaire was categorized as weak (below the median, score < 65), moderate (between the median and the third quartile, score: 65–69), and good (above the third quartile, score > 69).

Educational intervention

We applied identical lesson plans and evaluation techniques for students of TBT and FBL groups. Based on the recruiting university regulations, 15 students of each study group were divided into a group of seven students and eight students. Then, an OR instructor trained and supervised each group of seven to eight students in six five-hour field apprenticeship sessions weekly for three consecutive weeks. To reduce bias, each generated group of students was randomly assigned to the first and second hospitals with the same surgical procedures and environments. The study was performed first for eight students of the FBL group in the first hospital and eight students of the TBT group in the second hospital during the first three weeks of the semester. Then, it was conducted during the second three weeks of the semester for seven students of the FBL group in the second hospital and seven students of the TBT group in the first hospital.

Four eligible OR instructors were randomly assigned to the four generated groups of students to train and supervise the students (one per group). Only instructors with five years of experience in teaching the field apprenticeship courses were selected to reduce bias regarding using different instructors. Also, the program coordinator briefed all instructors regarding the program structure and process before initiating the study. The DOPS, performed to compare the students’ perioperative performance between the study groups, was also held under the same formats and conditions for the groups by a rater with prior experience in conducting the DOPS for OR students, who was unaware of the group assignment. To this end, on the last day of the three-week interventions, the rater observed students while doing skills and recorded their observations in the DOPS checklist. Eventually, the final score was noted for each student, which was only for research purposes. On the other hand, to report the student’s final score based on university regulations, an unstructured practical exam was held at the end of the semester, and students’ procedural skills and competencies were evaluated subjectively.

Before the commencement of the study, a briefing session was held for the two groups’ students regarding the research objectives, the type of desired technical-surgical skills, and their evaluation method. Then, students in the TBT group received traditional training, whereas those in the FBL group were taught with a feedback-based approach. The study was performed for two groups during the first and second three weeks of the semester. In the following weeks of the semester, students of two groups were taught with a traditional approach.

In the FBL group, during the first week, the corresponding instructor presented practical training on the desired technical-surgical skills and observed and evaluated the students’ perioperative performance using the DOPS checklist in 20–30 min. Immediately afterward, structured feedback was given to students in five to ten minutes in a private meeting by the corresponding instructor, using the sandwich method (i.e., highlighting both strengths and weaknesses of student performance). To this end, initially, the strengths and positive aspects of the student regarding her/his performance were mentioned. Then, constructive feedback was provided, and her/his weaknesses and negative points were discussed. Finally, once again, the strengths and positive points were reminded of the student, and the action plan was suggested. The student was also urged to engage in more practice and study to improve her/his performance. Ultimately, the feedback summary was documented descriptively within each student’s portfolio. This process of evaluation and providing feedback was repeated one week after the first week. Finally, the student’s checklist scores in two evaluation stages were compared to assess the student’s progress in the desired skills. An overview of the implemented program for one student is presented in Supplementary 1.

According to the traditional apprenticeship program, an OR instructor taught the desired skills and asked the students to accomplish the skills independently and frequently. In this method, general feedback was also provided to a group of students at the end of an apprenticeship day or the beginning of the following apprenticeship day. Additionally, individual feedback was presented immediately in emergencies and based on demand, but it was provided to all students in a written evaluation form at the end of the semester. In the traditional program, both group and individual feedback were provided based on the instructor’s own principles in an unstructured and arbitrary format, without following any standard in terms of steps of feedback provision and frequency. In these cases, no standard follow-up was conducted after feedback to see if students were improving based on the presented feedback.

Ethical considerations

The study was approved by the Regional Research Ethics Committee of Behbahan Faculty of Medical Sciences, Khozestan, Iran. Before the study commenced, all eligible students signed written informed consent after being provided with the research methods and objectives.

Data analysis

All analyses were run with the Statistical Package for Social Sciences software (version 25.00; SPSS Inc., USA). The Kolmogorov-Smirnov test did not confirm the normal distribution of data. Accordingly, the homogeneity of study groups for demographic-educational information was addressed with the Chi-square and Mann-Whitney U tests. Also, to compare the means of PPCS-R score between groups at baseline and post-test, the Mann-Whitney U test was employed. Additionally, this test was utilized to compare the groups regarding the mean changes in PPCS-R score from the baseline to the post-test. Finally, we used the Mann-Whitney U test to compare the post-test score of the DOPS checklist between the study groups. The significance level was deemed less than 0.05 in all tests.

Results

Basic characteristics

All 30 randomized students ended the trial and were incorporated into the final analysis. The results revealed no significant difference between the two groups regarding demographic-educational data (Table 1).

Table 1 Basic characteristics of the final-semester operating room technology students in the study groups

Perioperative competence

The students’ PPCS-R scores in the two study groups are presented in Table 2. The Mann-Whitney U test displayed no significant inter-group difference in the mean PPCS-R total score at baseline (P = 0.567). Yet, this test confirmed that the mean of the post-test total score obtained by the students in the FBL group was significantly higher than that acquired by the students in the TBT group (P < 0.001). Similarly, the mean scores of all PPCS-R dimensions were considerably higher in the FBL group than in the TBT group at the endpoint (P < 0.05). Also, the mean change of the PPCS-R total score from the baseline to the post-test was significantly higher in the FBL group compared to the TBT group (P < 0.001). Such finding was also found for the mean difference of all PPCS-R dimensions (P < 0.05), except for the “professional development dimension” (P = 0.285).

Table 2 The perioperative competence of the final-semester operating room technology students in the study groups

Perioperative performance

As demonstrated in Table 3, the Mann-Whitney U test showed that the mean scores of the DOPS checklist recorded for the students in the FBL group were significantly higher than those recorded for the students in the TBT group (P < 0.001).

Table 3 The perioperative performance of the final-semester operating room technology students in the study groups

Attitude toward FBL

The mean scores of the FBL attitude questionnaire obtained by students of the FBL group are presented in Table 4. Students’ attitudes toward FBL were mostly good (n = 8; 53.3%) or moderate (n = 5; 33.3%).

Table 4 The attitude toward feedback-based learning among the final-semester operating room technology students of the feedback-based learning group (n = 15)

Instructors’ perspectives

The FBL instructors were satisfied with the implemented program, and they felt that it could easily be incorporated into the daily routine by allocating enough training time and following a well-established approach. They also perceived that the presented feedback helped students to improve their knowledge and skills, as students thought of an idea as to whether the knowledge possessed was proper and relevant to their learning objectives and whether their performance was up to expected standards. Also, from the instructors’ perspectives, the FBL method could help students to engage in self-evaluation as well as boost their feedback-seeking behaviors and self-development concepts (i.e., self-motivation, self-confidence, self-esteem, and a sense of personal satisfaction), evoke their emotional reactions, and build a good relationship between students and their instructors, students and OR staff, students and patients, as well. The following are examples of quotes from the instructors:

If I did not provide feedback when I was busy, some students asked me eagerly to talk about their performance.

When I presented positive feedback regularly, it was followed by positive student reactions, and vice versa.

Discussion

This study sought to compare the impacts of apprenticeship training by sandwich feedback and traditional methods on perioperative competence and performance of final-semester OR technology students in an Iranian population. The results revealed that the students who received sandwich feedback following the DOPS assessment gained higher perioperative competence scores than those who trained by the traditional method without receiving specific or structured feedback. Also, the mean change of perioperative competence compared to the baseline was significant after training among students who received the sandwich feedback approach compared to those who received the traditional method. In addition, the students in the sandwich feedback group obtained higher DOPS scores than those in the traditional group, suggesting their better perioperative performance. Thus, the results backed the assumption that the sandwich feedback method could enhance perioperative competence and performance among OR technology students. Also, this method could improve students’ attitudes toward FBL.

The current study findings substantiate the evidence that evaluated the effectiveness of novel apprenticeship training approaches in the competence of OR students in Iran. In a recent study, Bahadori et al. indicated that final-semester OR technology students’ PPCS-R scores were significantly higher in the task-based learning group than in the mentorship group [13]. Also, Mirbagher Ajorpaz et al. documented that OR apprenticeship training by mentorship, compared to traditional training, was associated with a significant increase in scores of PPCS-R [5]. Similarly, Sharif et al. reported that OR students’ scores on PPCS-R increased more after receiving the mastery learning model than the traditional method [23]. The results of the present study are compatible with the literature mentioned above, which showed the superiority of active-learning approaches compared to traditional ones in improving the students’ perioperative competence. The effectiveness of the sandwich feedback approach on the perceived perioperative competence in the current study can be justified by the fact that following proper and effective feedback, the student’s awareness of the developing competence will increase, resulting in a better evaluation of their clinical competence.

The current study also demonstrated that providing sandwich feedback following the DOPS assessment could enhance perioperative performance. Based on the results, two domains of “information about the anatomy of the surgical site” and “technical skills in surgery” had the lowest scores in both the FBL and TBT groups. According to the literature, limited investigations have been conducted to record feedback effects on the psychomotor skills of students in the OR fields. A recent systematic review reported that feedback based on intraoperative surgical performance was a powerful technique for improving the performance of surgical residents [4]. Also, Nayyeri et al. showed that using the DOPS evaluation accompanied by providing simple feedback compared to the traditional method substantially improved the perioperative performance of Iranian OR technology students [21]. The effectiveness of feedback on performance can be attributed to most students’ acceptance of this method, as feedback becomes valid and impactful when embraced by students [17].

Based on the findings, FBL could improve students’ attitudes toward FBL in four dimensions of “diagnosis”, “prognosis”, “motivation and sense of belonging”, and “the contribution of FBL to learning improvement”. Students’ perceptions indicated that FBL allowed instructors to make an adequate ongoing diagnosis and regularly understand their difficulties, weaknesses, and strengths; subsequently, the instructors mapped their problems, successfully dealt with them, and resolved them for each student. Also, based on students’ perceptions, FBL gave them the sense that the instructor was interested in them and their learning, which boosted their inspiration to learn and ask questions. Besides, the students believed that FBL substantially enhanced their learning process due to a better understanding of the material and meaningful learning. Previous studies in Iran also reported students’ positive attitudes toward receiving feedback, which agrees with the current study’s findings [15, 24]. In addition, we understood that the satisfaction of FBL instructors toward the implemented program was reasonable, and they believed that such programs are feasible to be incorporated into conventional training.

Study strengths

This work is the initial attempt to implement sandwich feedback following the DOPS assessment. Besides, it is the second one regarding the use of DOPS assessment in Iranian OR technology students. We executed group allocation based on the stratified randomization method to reduce selection bias, which could be one of the most substantial aspects of this study. Additionally, to limit the dissimilarities in academic and environmental characteristics between groups, students were chosen from one university, and training was presented by the instructors with the same experience. Also, the DOPS rater was the same for all students and was blinded to group allocation, which could be another strength of the current study. Likewise, most previous related studies assess either competence or performance. However, we considered the evaluation of both perioperative competence and performance. Finally, we investigated students’ attitudes toward FBL and instructors’s perspectives regarding the implemented program.

Study limitations

Although the study participants were recruited via census, the small sample size can limit the generalizability of the present findings. Likewise, the students were selected from a single center in Iran; therefore, the results might only be representative of some of the community. Finally, we performed a short-term intervention; hence, whether the observed effects persisted over a long period is unclear.

Study implications for educational practice and future research

The current investigation could present beneficial evidence for OR instructors seeking innovative solutions to improve students’ perioperative competence and performance. Based on the results, providing sandwich feedback following the DOPS assessment can be potentially valuable as an alternative method to traditional approaches for apprenticeship training of Iranian OR technology students. Subsequently, since clinical instructors have an ethical and professional responsibility to foster students’ clinical competence and performance by implementing practical, easy usage, and evidence-based strategies, they are suggested to consider the FBL in a similar format in other schools. Nevertheless, to assess the generalizability of the findings and provide more reliable evidence on the efficacy of FBL in the perioperative field, forthcoming multi-center investigations with more samples are needed to consider the long-term impacts of this method on the study outcomes among students with comparable demographics or those who participate in other apprenticeship courses.

Conclusions

Short-term FBL, which included providing sandwich feedback following the DOPS assessment for three consecutive weeks, was more effective than the traditional training in improving perioperative competence and performance of final-semester OR technology students. Also, the attitude toward FBL was good-to-moderate among the students who received the FBL. Similarly, the instructor’s satisfaction with the FBL was acceptable, and they believed that such programs are feasible to be integrated into conventional training.

Data availability

Data and materials are obtainable by contacting the corresponding author.

Abbreviations

a :

Cronbach’s alpha

ALOBA:

Agenda Led Outcome-based Analysis

BS:

Bachelor of Science

CVI:

Content Validity Index

I-CVI:

Item-level Content Validity Index

CVR:

Content Validity Ratio

DOPS:

Direct Observation of Procedural Skills

FBL:

Feedback-Based Learning

GREET:

Guideline for Reporting Evidence-based Practice Educational Interventions and Teaching

ICC:

Intraclass Correlation Coefficient

OR:

Operating Room

PPCS-R:

Perceived Perioperative Competence Scale-Revised

R2C2:

Rapport/Reaction/Content/Coach

SPSS:

Statistical Package for Social Sciences software

TBT:

Traditional-Based Training

References

  1. Nasiri M, Eslami J, Rashidi N, Paim CPP, Akbari F, Torabizadeh C, et al. Playing with Surgical Instruments (PlaSurIn) game to train operating room novices how to set up basic surgical instruments: a validation study. Nurse Educ Today. 2021;105:105047. https://doi.org/10.1016/j.nedt.2021.105047.

    Article  Google Scholar 

  2. Akbari F, Nasiri M, Rashidi N, Zonoori S, Amirmohseni L, Eslami J, et al. Comparison of the effects of virtual training by serious game and lecture on operating room novices’ knowledge and performance about surgical instruments setup: a multi-center, two-arm study. BMC Med Educ. 2022;22(1):268. https://doi.org/10.1186/s12909-022-03351-5.

    Article  Google Scholar 

  3. Flinn JT, Miller A, Pyatka N, Brewer J, Schneider T, Cao CG. The effect of stress on learning in surgical skill acquisition. Med Teach. 2016;38(9):897–903.

    Article  Google Scholar 

  4. Trehan A, Barnett-Vanes A, Carty MJ, McCulloch P, Maruthappu M. The impact of feedback of intraoperative technical performance in surgery: a systematic review. BMJ Open. 2015;5(6):e006759.

    Article  Google Scholar 

  5. Mirbagher Ajorpaz N, Zagheri Tafreshi M, Mohtashami J, Zayeri F, Rahemi Z. The effect of mentoring on clinical perioperative competence in operating room nursing students. J Clin Nurs. 2016;25(9–10):1319–25. https://doi.org/10.1111/jocn.13205.

    Article  Google Scholar 

  6. Nasiri M, Yektatalab S, Momennasab M, Vizeshfar F. Development and assessment of validity and reliability of a checklist to evaluate the circulating and Scrub skills of operating Room novices (CSSORN checklist). J Educ Health Promot. 2023;12:65. https://doi.org/10.4103/jehp.jehp_338_22.

    Article  Google Scholar 

  7. SCPMS. B.Sc. Of operating room technology curriculum. Tehran, Iran: Ministery of Health and Medical Education of Iran; 2014.

    Google Scholar 

  8. Nasiri M, Yektatalab S, Momennasab M, Vizeshfar F. Using objective structured clinical examination (OSCE) for circulating and scrub skills of first-semester operating room technology students: is it valid and reliable? Heliyon. 2023;9(3):e14395. https://doi.org/10.1016/j.heliyon.2023.e14395.

    Article  Google Scholar 

  9. Yazdimoghaddam H, Samadipour E, Ghardashi F, Borzoee F, Akbarzadeh R, Zardosht R, et al. Designing a comprehensive clinical competency test for operating room technology student: using Delphi technique and CIPP model evaluation. J Educ Health Promot. 2021;10:240. https://doi.org/10.4103/jehp.jehp_1563_20.

    Article  Google Scholar 

  10. Sedigh A, Bagheri S, Naeimi P, Rahmanian V, Sharifi N. The effect of peer mentoring program on clinical academic progress and psychological characteristics of operating room students: a parallel randomized controlled trial. BMC Med Educ. 2024;24(1):438. https://doi.org/10.1186/s12909-024-05424-z.

    Article  Google Scholar 

  11. Masoumian Hosseini M, Sadat Manzari Z, Gazerani A, Masoumian Hosseini ST, Gazerani A, Rohaninasab M. Can gamified surgical sets improve surgical instrument recognition and student performance retention in the operating room? A multi-institutional experimental crossover study. BMC Med Educ. 2023;23(1):907. https://doi.org/10.1186/s12909-023-04868-z.

    Article  Google Scholar 

  12. Khorammakan R, Omid A, Mirmohammadsadeghi M, Ghadami A. Puzzle game-based learning: a new approach to promote learning of principles of coronary artery bypass graft surgery. BMC Med Educ. 2023;23(1):241. https://doi.org/10.1186/s12909-023-04156-w.

    Article  Google Scholar 

  13. Bahadori H, Imani B, Amiri MH. The effects of task-based learning and mentorship on the perceived surgical competency and clinical education condition of surgical technology students. Nurs Midwifery Stud. 2022;11(3):183–9.

    Article  Google Scholar 

  14. Ghilay Y. The second generation of feedback-based learning model (FBL-2 g) for quantitative courses in higher education. J e-Learning Knowl Soc. 2018;14(3).

  15. Ahmady S, Zand S, Nikravan-Mofrad M, Rafiei F. Student satisfaction on getting feedback in clinical teaching. J Med Educ Dev. 2015;10(3):208–18.

    Google Scholar 

  16. Orsini C, Rodrigues V, Tricio J, Rosel M. Common models and approaches for the clinical educator to plan effective feedback encounters. J Educ Eval Health Prof. 2022;19:35. https://doi.org/10.3352/jeehp.2022.19.35.

    Article  Google Scholar 

  17. Procházka J, Ovcari M, Durinik M. Sandwich feedback: the empirical evidence of its effectiveness. Learn Motiv. 2020;71:101649.

    Article  Google Scholar 

  18. LeBaron SW, Jernick J. Evaluation as a dynamic process. Fam Med. 2000;32(1):13–4.

    Google Scholar 

  19. Phillips AC, Lewis LK, McEvoy MP, Galipeau J, Glasziou P, Moher D, et al. Development and validation of the guideline for reporting evidence-based practice educational interventions and teaching (GREET). BMC Med Educ. 2016;16(1):237. https://doi.org/10.1186/s12909-016-0759-1.

    Article  Google Scholar 

  20. Mirbagher Ajorpaz N, Tafreshi MZ, Mohtashami J, Zayeri F, Rahemi Z. Psychometric testing of the Persian version of the perceived perioperative competence scale-revised. J Nurs Meas. 2017;25(3):162–72. https://doi.org/10.1891/1061-3749.25.3.e162.

    Article  Google Scholar 

  21. Nayyeri S, Bozorgvar A, Barzanouni S, Hosseini TM. Effect of clinical skills evaluation by Direct Observation of Procedural skills (DOPS) method on clinical performance of operating room students. J Med Edu. 2021;20(3). https://doi.org/10.5812/jme.119342.

  22. Polit DF, Yang F. Measurement and the measurement of change, Wolters Kluwer Philadelphia, PA; 2016.

  23. Sharif M, Mirbagher Ajorpaz N, Arandian N. Effects of mastery learning model on clinical competencies in the operating room students. Community Health J. 2017;10(3):11–8.

    Google Scholar 

  24. Imanipour M, Razaghi Z, Khajeh K. Orientation to receive feedback among medical and nursing students of Shahid Beheshti University of Medical Sciences, 2019. J Med Educ Dev. 2021;13(39):56–63. https://doi.org/10.29252/edcj.13.39.60.

    Article  Google Scholar 

Download references

Acknowledgements

The authors thank the Vice-chancellors for Research Affairs of the Behbahan Faculty of Medical Sciences. They would also appreciate the volunteer participation of OR technology students in the study. Thanks also go to the OR instructors for their invaluable assistance in training and supervising the students. Finally, medical education professionals are acknowledged for their worthwhile contribution to evaluating the content validity of the feedback-based learning attitude questionnaire.

Funding

This work was funded by the Behbahan Faculty of Medical Sciences (Grant No. 14022211). The funding body had no role in the study design, data collection, analysis, interpretation, and manuscript writing.

Author information

Authors and Affiliations

Authors

Contributions

AH and MN: Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Project administration, Software, Writing original draft; FK: Conceptualization, Methodology, Supervision, Validation, Visualization, Writing- review & editing; TA: Conceptualization, Methodology, Resources, Funding acquisition, Writing - review & editing; HS: Methodology, Investigation, Supervision, Writing- review & editing.

Corresponding author

Correspondence to Tayebeh Arabzadeh.

Ethics declarations

Ethics approval and consent to participate

The Ethics Committee of Behbahan Faculty of Medical Sciences approved the current study (approval code: IR.BHN.REC.1402.033). All the students were briefed about the study’s purposes, their voluntary participation, and the confidentiality of their declared information. Also, they signed an informed consent document before the initiation of the study. Besides, all methods were performed in accordance with the relevant guidelines and regulations.

Consent for publication

No individual data are incorporated in this study.

Competing interests

The authors declare no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary Material 1

Supplementary Material 2

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hosseinpour, A., Nasiri, M., Keshmiri, F. et al. Comparison of the effects of apprenticeship training by sandwich feedback and traditional methods on final-semester operating room technology students’ perioperative competence and performance: a randomized, controlled trial. BMC Med Educ 24, 578 (2024). https://doi.org/10.1186/s12909-024-05598-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12909-024-05598-6

Keywords