A prospective, blinded evaluation of a video-assisted ‘4-stage approach’ during undergraduate student practical skills training
© Schwerdtfeger et al.; licensee BioMed Central Ltd. 2014
Received: 2 May 2013
Accepted: 9 May 2014
Published: 22 May 2014
The 4-stage approach (4-SA) is used as a didactic method for teaching practical skills in international courses on resuscitation and the structured care of trauma patients. The aim of this study was to evaluate objective and subjective learning success of a video-assisted 4-SA in teaching undergraduate medical students.
The participants were medical students learning the principles of the acute treatment of trauma patients in their multidiscipline course on emergency and intensive care medicine. The participants were quasi- randomly divided into two groups. The 4-SA was used in both groups. In the control group, all four steps were presented by an instructor. In the study group, the first two steps were presented as a video. At the end of the course a 5-minute objective, structured clinical examination (OSCE) of a simulated trauma patient was conducted. The test results were divided into objective results obtained through a checklist with 9 dichotomous items and the assessment of the global performance rated subjectively by the examiner on a Likert scale from 1 to 6.
313 students were recruited; the results of 256 were suitable for analysis. The OSCE results were excellent in both groups and did not differ significantly (control group: median 9, interquantil range (IQR) 8–9, study group: median 9, IQR 8–9; p = 0.29). The global performance was rated significantly better for the study group (median 1, IQR 1–2 vs. median 2, IQR 1–3; p < 0.01). The relative knowledge increase, stated by the students in their evaluation after the course, was greater in the study group (85% vs. 80%).
It is possible to employ video assistance in the classical 4-SA with comparable objective test results in an OSCE. The global performance was significantly improved with use of video assistance.
KeywordsTeaching methods Medical students Trauma care
Practical clinical skills are essential requirements for physicians and should be thoroughly learned during medical school training. The demands on the medical schools to teach these skills have increased considerably since the introduction of the new German licensing regulations for physicians .
Real-time demonstration of the skill by the instructor.
Repetition of the demonstration by the instructor with a detailed explanation.
Repetition of the demonstration by the instructor following instructions from a trainee.
Repetition of the demonstration by the trainee and practice of the skill by all trainees.
According to Bullock, the 4-SA can facilitate learning of practical skills . The four stages successively transfer the responsibility of performing a skill from the instructor to the trainee. Continuous repetition will lead to a steady improvement of the skill. However, the method is time consuming and personnel-intensive . Several studies have shown that simple technical skills can also be taught with a markedly reduced didactic approach [5, 6]. Moreover, the subject matter required for exams should be taught to the entire cohort in a consistent manner in order to achieve successful learning and passing grades in final examinations of modules that are part of the curriculum.
The aim of this study was to evaluate to which extent a video-assisted 4-SA is feasible and whether it can be effectively integrated into a required module of the curriculum. Furthermore, we hypothesized that equally good OSCE test results can be achieved using a video-assisted 4-SA despite reduced personnel requirements.
All students enrolled in the multidisciplinary curricular course “emergency and intensive care medicine” in the summer semester 2011 and winter semester 2011/2012 were recruited for the study. All students consented to participate in this analysis and to have their test results evaluated for the purposes of this study.
Because there was no patient contact and no patient data was analyzed, the local institutional ethics committee waived the need to formally consider this study as a clinical trail, but did approve to the conductance of the study (number 24/5/13An).
At the end of the two-week multidisciplinary course each student was tested in five relevant topics of emergency and intensive care medicine at five distinct OSCE stations by faculty members. In one of these five tests the students had to perform a structured clinical examination of a simulated trauma patient. The faculty examiners (OS and KS) were blinded to the student’s group assignment.
Objective test results
The students’ performance was evaluated at the five-minute “trauma care” OSCE station using a checklist of nine dichotomous items (e.g. evaluation of consciousness, palpation of peripheral pulse, auscultation of bilateral lung fields, measurement of capillary refill, abdominal examination), focusing on the steps A, B and C of the ABCDE mnemonic protocol.
Subjective opinion of the examiner (assessment of the global performance)
In addition to the checklist, the examiners added a subjective assessment of the student’s global performance using a Likert scale of 1 to 6 (1 = very good, 6 = failed). This served to describe the overall impression of a student’s performance during the clinical examination of a simulated trauma patient, independent of the objective parameters. This global performance evaluation did not influence the student’s final grade.
Student’s subjective impression of knowledge gained and free-text comments
The medical school evaluates all courses of the undergraduate curriculum with standardized online surveys regarding the learning outcomes. Pre- and posttest student self-assessments serve to monitor the teaching quality . In addition, students rate their subjective perception of their own acquired skills on a six-point scale (from ‘fully agree’ to ‘not at all true’). In regards to the structured evaluation of pre-hospital trauma patients, students needed to evaluate the following statement: “I am capable to perform a structured evaluation of pre-hospital trauma patients”. In addition, the results of this survey served as an external quality control measure for the present study. Furthermore, post-course, anonymous free-text student comments were analyzed as an additional component for external evaluation. Positive and negative comments about teaching formats and didactical methods for the required course as a whole and separately for the topic of the studied module were tallied. The data from the two semesters prior to the beginning of the study were compared to those of the two semesters of the study.
Data analysis and statistical methods
The examination protocols were machine read by the department of information technology of the medical faculty. The data was stored in Microsoft Excel 2010® worksheets and made available to the authors. Statistical analysis was performed with Statistica 10 (StatSoft). All results are presented as median, 25–75 interquartile range (IQR), and were analyzed utilizing the Mann–Whitney U-test.
A total of 313 students were recruited for the study. Fifty-seven students were excluded from the final analysis (control group 29; study group 27) as the global assessment had not been completed. Of the remaining 256 students, 129 were in the control group (73 female, 56 male) and 127 in the study group (77 female, 50 male).
Objective checklist evaluation
Assessment of the global performance
Knowledge increase and free-text comments
Analysis of the free-text comments at the end of the multidiscipline course
All comments (n)
Course topic “trauma” (n)
% regarding “trauma”
Utilization of resources
Two instructors are required for steps one and two of a 4-SA. The presence of a second instructor is not necessary during the video-assisted presentation of step one and two (approximately 20 minutes in total). Assuming an average of 155 students per semester und a maximum group size of six students (corresponds to 26 groups), this would result in the saving of 520 minutes, which is equal to one man-day.
Exclusion of data
As the global scoring has not been an integral and compulsory part of the OSCE examination, the assessors occasionally did not complete the global scoring. For good clinical practice we hence excluded all students from further analysis, if the intended data set was incomplete. A separate analysis of the entire data set revealed no difference in the check list analysis (p = 0.69), thus we were able to exclude any bias.
In this study we investigated the feasibility of using a video-assisted 4-SA during student training and evaluated how it might affect the students’ performance in exams.
The objective test performance after the video-assisted 4-SA was similar to that after a conventional 4-SA and hence the video-assisted 4-SA did not improve the objective test performance. Our results are therefore similar to those of Sopka et al. who studied a media-assisted 4-SA for training basic life support (BLS) and showed that media-assisted 4-SA was equivalent to traditional 4-SA in teaching BLS .
The global performance assessed by the examiners was significantly improved by the use of the video-assisted 4-SA. Educational psychology might offer an explanation for this improvement in the global performance scores. Although favorable learning conditions had been created in both groups by the multiple repetitions, there was a change of media in the study group; from video in steps one and two to instructor in steps three and four. This has been shown to enhance knowledge acquisition .
Videos can be used to show moving images and spoken language and, in addition, a multitude of effects such as superimposed text, animation or slow-motion clips. An optimal observation point can be provided for all viewers so that important details become and remain visible. Even difficult-to-illustrate situations can thus be reproduced with the help of videos. In addition, the videos can be made available to the students before the begin of the course to promote a type of “blended learning” . In our study we used text overlays in the second step of the video-assistet 4-SA. Vester  was the first to describe the 4 different learning styles. According to Vester these include the auditive, the visual, the haptic and the intellectual learning type. In this regard, the visual learning type could benefit from changing the acoustic explanation in the control group to the visual overlay in the study group. On the other hand, there is no solid evidence to confirm Vester’s theorie of learning, which has been critiqued in the past .
Although there are some pedagogic arguments in favor of a 4-SA, no scientific study has shown an objective advantage of the method. Orde et al. compared the 4-SA to traditional two-step methods (2-SA; “see one, do one”) for teaching the insertion of a laryngeal mask airway. The 2-SA required less time and the performance of the participants was adequate . In another study, Greif et al., who compared the 4-SA and traditional teaching methods for teaching needle cricothyrotomy, came to similar conclusions. Leaving out steps two and three of the 4-SA did not result in a difference of the time required to complete a cricothyrotomy or the number of repetitions required before the participant considered himself adequatelytrained . Furthermore, Jenko et al. compared a 2-SA and a 4-SA for teaching chest compression and showed no difference in the results of the two teaching methods . However, in these three studies the skill that was taught and evaluated may be considered simple and one-dimensional, at least in the teaching model that was applied in the course [5, 6, 13]. Moreover, teaching the structured clinical care of a trauma patient is a complex process, and to our knowledge there are no studies comparing the 2-SA with the 4-SA in the teaching of complex skills.
The conventional 4-SA is not only time consuming and personnel-intensive but also requires well-qualified instructors to guarantee a consistent level of teaching quality independent of the person teaching. In our study, the teaching video has demonstrated the potential to markedly reduce personnel requirements without negatively affecting student performance compared to the 4-SA with two instructors. Importantly, the video-assisted 4-SA was able to reduce the personnel requirements for each one two-week module by a full one man-day, while simultaneously providing an identical presentation of the subject matter. This calculation is limited to our 4 SA with two instructors. Interestingly, the number of negative free-text comments in the evaluation diminished, and an increase in the number of positive comments on the module on trauma management was noted after our study began. In particular the differing presentation styles and priorities of individual instructors in steps one and two of the 4-SA, which were often criticized before starting the study, were standardized with the help of the videos. Moreover, the differences in the presentation styles in the control group were also reduced since the instructors began using the videos to prepare their own lessons as the videos were available to the faculty instructors before the study began to prepare for the course.
The subjective assessment of the students’ relative knowledge increase differed during the two study semesters. It is important to keep in mind that this subjective assessment depended partly on the extent of the participants’ prior knowledge, which was not determined before the course, and thus the resulting relative increase in knowledge must be interpreted with caution. Our study results offer no explanation for the differing results.
One shortcoming of our study is that there was no objective pre-evaluation determining the previous experience of the individual participants and that there was no longitudinal follow-up. Furthermore, we did not collect data for demographic differences between the study groups except for gender. This information potentially could have been useful in assessing the results of the relative increase in knowledge, and in detecting potential differences in the persistence of the imparted knowledge depending on the teaching method. A further limitation of the study was that due to organizational factors it was not possible to maintain the same interval between intervention (course) and data acquisition (OSCE).
The comparison of two methods for teaching acute clinical care of trauma patients yielded similar results for the traditional 4-SA and a video-assisted 4-SA with respect to the objective test results. Although less personnel is required the video-assisted 4-SA, this method can be of use in improving the global performance of students in an OSCE. In addition, video-assisted 4-SA may contribute to a more consistent level of teaching quality.
Advanced life support
Basic life support
European trauma course
Objective structured clinical examination
Prehospital trauma life support
Four stage approach.
- Bundesministerium für Gesundheit: Approbationsordnung für Ärzte. Bundesgesetzblatt, Volume 44. 2002, 2405-2435.Google Scholar
- Timmermann A, Roessler M, Barwing J, Blaschke S, Brauer A, Eich C, Hirn A, Klockgether Radke A, Nickel E, Russo S, Kettler D, Saur P: New pathways in undergraduate medical education - first experiences with the cross section speciality emergency and intensive care medicine. Anasthesiol Intensivmed Notfallmed Schmerzther. 2005, 40 (9): 536-543. 10.1055/s-2005-870108.View ArticleGoogle Scholar
- Bullock I: Skill acquisition in resuscitation. Resuscitation. 2000, 45 (2): 139-143. 10.1016/S0300-9572(00)00171-4.View ArticleGoogle Scholar
- Peyton JWR: Teaching & learning in medical practice. 1998, Rickmansworth: Manticore EuropeGoogle Scholar
- Orde S, Celenza A, Pinder M: A randomised trial comparing a 4-stage to 2-stage teaching technique for laryngeal mask insertion. Resuscitation. 2010, 81 (12): 1687-1691. 10.1016/j.resuscitation.2010.05.026.View ArticleGoogle Scholar
- Greif R, Egger L, Basciani RM, Lockey A, Vogt A: Emergency skill training–a randomized controlled study on the effectiveness of the 4-stage approach compared to traditional clinical teaching. Resuscitation. 2010, 81 (12): 1692-1697. 10.1016/j.resuscitation.2010.09.478.View ArticleGoogle Scholar
- Caroline NL: Emergency care in the streets. 1979, Boston: Little, Brown, 1Google Scholar
- Schiekirka S, Reinhardt D, Beissbarth T, Anders S, Pukrop T, Raupach T: Estimating learning outcomes from pre- and posttest student self-assessments: a longitudinal study. Acad Med. 2013, 88 (3): 369-375. 10.1097/ACM.0b013e318280a6f6.View ArticleGoogle Scholar
- Sopka S, Biermann H, Rossaint R, Knott S, Skorning M, Brokmann JC, Heussen N, Beckers SK: Evaluation of a newly developed media-supported 4-step approach for basic life support training. Scand J Trauma Resusc Emerg Med. 2012, 20 (1): 37-10.1186/1757-7241-20-37.View ArticleGoogle Scholar
- Hasselhorn M, Gold A: Pädagogische Psychologie: erfolgreiches Lernen und Lehren, 2., durchges. Aufl. edn. 2009, Stuttgart: KohlhammerGoogle Scholar
- Greenhalgh T: Computer assisted learning in undergraduate medical education. BMJ. 2001, 322 (7277): 40-44. 10.1136/bmj.322.7277.40.View ArticleGoogle Scholar
- Vester F: Denken, Lernen, Vergessen: was geht in unserem Kopf vor, wie lernt das Gehirn, und wann lässt es uns im Stich? mit zahlr. Abb, 35. Aufl edn. 2012, München: Dt. Taschenbuch-VerlGoogle Scholar
- Looß M: Lerntypen? Ein pädagogisches Konstrukt auf dem Prüfstand. Die deutsche Schule. 2001, 93 (2): 186-198.Google Scholar
- Jenko M, Frangez M, Manohin A: Four-stage teaching technique and chest compression performance of medical students compared to conventional technique. Croat Med J. 2012, 53 (5): 486-495. 10.3325/cmj.2012.53.486.View ArticleGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6920/14/104/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited.