- Open Access
Comparative study of virtual and face-to-face training methods on the quality of healthcare services provided by Kermanshah pre-hospital emergency staff (EMS): randomized educational Intervention trial
BMC Medical Education volume 22, Article number: 203 (2022)
Emergency medical centers are globally one of the most important pillars of pre-hospital care. The most important purpose of this system is to provide satisfactory services in the shortest possible time and in accordance with the modern scientific standards of the world. The present study aimed to compare the effect of virtual and face-to-face training methods on the quality of service provided by Kermanshah pre-hospital emergency personnel, Iran.
This was a randomized educational intervention trial performed among the staff of Kermanshah Emergency Medical Center. Individuals were randomly divided into two training groups of virtual and face-to-face. Participants in the face-to-face group received slides, lectures, and practical work with moulage for 6 h a day. Subjects were taught the four skills of intubation, laryngeal mask airway (LMA), cardiopulmonary resuscitation (CPR) and attenuated electrical device (AED). Participants in the virtual group received the same content in the form of a training video on CD with a full explanation of the project's objectives. Pre- and post-test scores of participants were compared within and between the groups by Stata 14.0 software.
Eighty-seven individuals were participated in the study, 43 of whom were assigned to the face-to-face training group and 44 to the virtual training group. There was no significant difference between the two groups in terms of work experience and educational level (P > 0.05). Post-training scores in both groups were significantly higher than pre-training in the four skills (P ≤ 0.005). After adjusting for educational level and work experience, however, the quality of CPR, intubation, and AED was higher in the face-to-face training group than in the virtual group. However, the increase in the mean score of LMA in the virtual training was not significantly different than that of the face-to-face training group.
The results of our study showed the same efficacy of both face-to-face and virtual methods in improving the performance of personnel in tracheal intubation, LMA, CPR and AED shock skills. E-learning methods can be used as a complement to face-to-face methods in education.
Iran ranks fourth among the countries at risk for natural disasters. Of the 40 types of natural disasters observed in the world, 31 occur in Iran with an emphasis on earthquake in comparison to other hazards . Also, with the increase in the number of motor vehicles, the number of fatalities due to accidents has increased and has become a threat to health systems in developing and developed countries . Pre-hospital emergency system plays a major role in providing healthcare services and is at the forefront of dealing with patients and casualties caused by these accidents . Therefore, its employees must have precise information and updated training. Because when they faced with life-threatening conditions outside the hospital, should be able to limit mortality by timely diagnosis and treatment.
According to research, sustained educational programs play an essential role in enhancing the knowledge and ability of medical staff [4, 5]. These programs are divided into two categories: face to face and virtual, each having its own advantages and disadvantages. The benefits of the face-to-face approach include the presence of the learner in the actual situation of instruction, the opportunity to see live teacher activities and instruction, and the opportunity for question and answer between learner and teacher. Disadvantages of the face to face method include the cost of organizing programs, the difficulty of providing the conditions, the inability of some learners to attend due to occupational or distance restrictions, the inability of all learners to participate actively, and the inability to provide this training to larger groups. However, virtual education is cheap and easy to reproduce, has no spatial limitations, is more viable in times of scarcity of human resources (lecturers or learners), can accommodate larger demographic groups, and is easier to be held compare to the face to face method. Alongside these benefits are factors that may reduce the effectiveness of this method. These include lack of virtual education equipment, lack of skill in using these equipment, confounding factors in the delivery of training (such as noise pollution on site and disruption of learner focus), and lack of live learning environment for learners [6, 7].
Virtual training is increasingly used in medical education such as nursing students’ practical skills, the teaching of oral pathology and anatomy, radiology, parasitology, etc. [8,9,10,11,12]. Many authors have expressed positive role of this approach in education such as reducing training costs, unlimitedly repetition of the same training, time flexibility, comfort and lack of transportation worries . Examples exist within the literature which highlighted the effectiveness and values of both methods in teaching system [14, 15]. Nevertheless, a number of studies have reported that one of the virtual or traditional methods has been more effective than the other [16,17,18]. Given the inconsistency in the research findings and the sparsity of pre-hospital staff workplaces in Kermanshah Province and the need for regular sustained educational programs for them, the present study aimed to compare the effect of virtual and face to face training methods on the quality of service provided by Kermanshah pre-hospital emergency personnel.
This randomized educational intervention trial study was conducted from 22 December to March 2017 in Kermanshah University of Medical Sciences, Iran.
The face to face teaching method has a greater impact on the quality of pre-hospital services than the virtual method.
Sample and sampling method
The study population included all the pre-hospital personnel in Kermanshah Province. Sample size was calculated at 88 individuals based on Shaw’s study  with a first-order error of 0.05 and 80% power. The final sample size was estimated to be 98 considering 10% attrition. In this study, all pre-hospital staff were surveyed, some of whom were excluded from the initial study due to not meeting the inclusion criteria. The inclusion criteria included consent to participate in the study, computer literacy (based on individual statements), access to a computer, and employment in the Emergency Department of Kermanshah University of Medical Sciences.
Finally, 87 eligible individuals were randomly divided into two groups (1:1 ratio) via sealed opaque envelopes with labeled 1 to 87. The individual’s training group was allocated when the envelope was opened (Fig. 1). No exclusion criteria were considered for this study.
In Iran, there is a lack of a protocol based on scientific evidence for evaluating the adequacy of therapeutic interventions. To this end, information related to American Heart Association's standard protocols were drawn and then evaluated in a meeting with the respective experts. Afterwards, standard questionnaire were designed on that basis. This questionnaire tapped into the four areas of tracheal intubation (4 questions), laryngeal mask airway (LMA) (9 questions), cardiopulmonary resuscitation (CPR) (12 questions) and attenuated electrical device (AED) (6 questions). The Cronbach's alpha coefficient was used to check the reliability of questionnaire by those four areas (The Cronbach's alpha was for LMA=0.76, CPR=0.82, AED=0.89, intubation=0.70). Initially, participants' skill level in providing pre-hospital services was assessed in person using an American Heart Association checklist by an emergency medicine specialist (third author) for three days at the emergency medical center. The participants' pre-test scores were recorded in the study.
Intervention in the face-to-face group in the four areas of tracheal intubation, LMA, CPR, and AED was performed in the form of lecture, slide show, and film and practical work for 6 h a day. The intervention was repeated the next day to allow for the enrollment of the participants who were unable to participate in the training on the first day due to occupational restrictions. The training was held in the Clinical Skills Hall of the Imam Reza Hospital, Kermanshah University of Medical Sciences, Kermanshah, Iran.
In the virtual training group, all of the above contents were recorded as a lecture, slide show, and film in collaboration with the Education Development Center of University of Medical Sciences (EDC), and then implemented on a CD. The CDs were given to the virtual training group by the emergency medicine center. The two groups' training programs were provided by an emergency medicine specialist (first author) with the same content. Based on the previous valuable literature , one month after the completion of the training, the participants' proficiency was re-assessed as a face-to-face test, such as a pre-test. The test was performed in both groups on a moulage for three days at the emergency medicine center by the person who performed the pre-test using a checklist.
Due to the nature of the study, no blinding was performed. To encourage these individuals to continue working until the end of the project, measures such as assigning re-training points to both virtual and face-to-face training groups were undertaken.
Descriptive indices including frequency and percentage (for qualitative variables) as well as mean and standard deviation (for quantitative variables) were used to describe the data. To analyze the data, the Chi-square test was used to compare the qualitative variables between the two groups. In order to compare the quantitative variables between the two study groups, independent t-test (in case of normal distribution of the data) was used. In order to compare pre-test and post-test scores in each group, paired t test was applied. Analyzes were performed using Stata 14.0 software. The significance level was defined as 0.05.
The flowchart of our study population is shown in Fig. 1. As shown, 53 of 140 participants were excluded from the study for personal reasons. A total number of 87 EMS personnel participated, 43 (49.43%) in the face-to-face group and 44(50.57%) in the virtual group. All the participants in this study were male, given that pre-hospital emergency technicians are largely male in Iran. There was no significant difference in the work experience, age and educational level between the two groups (Table 1). Table 2 shows mean pre-test scores of the participants of two groups in the four studies skills (tracheal intubation, LMA insertion, CPR, and AED use). As seen, no significant difference was observed using independent t-test between the two groups regarding pre-test scores (29.0 ± 6.1 for the face-to-face group vs 28.4 ± 5.1for the virtual group; P = 0.613).
As it is shown in Table 3, in comparison of mean score differences in each skill, an increase in the mean score in the tracheal intubation, CRP, and AED was seen in face-to-face group in comparison to virtual group. Nevertheless, increase in score of tracheal intubation was seen in the virtual group in comparison to face-to-face group, although it was not statistically significant (P = 0.538). Also, the findings of the research showed that both groups had significantly higher total score and scores of each skill in the post-test (P ≤ 0.005) (Table 3).
A worldwide shortage of health professionals in the health care system is an age-old problem and has negative effects on patient outcomes and quality health care. The development of virtual medical education courses can provide a lot of educational opportunities for students in low- and middle-income countries and reduce this shortage .
In this present study, we found no significant difference between virtual training group and face-to-face training group in all skills (CPR, tracheal intubation, LMA, and AED) and both methods appear to be effective. Furthermore, all participants in face-to-face and virtual learning methods completed this study that can reflect their willingness to use these two methods. Despite different study populations, our findings are in line with the study of Khatony et al. (2009) who did not find significant difference between the electronic and traditional educational methods in learning the principles of caring HIV positive patients . According to the findings of Mahadevan’s research (2018), there was no significant difference between the online and traditional classroom course in knowledge gain among Ugandan medical students participating on emergency medicine . Aminizadeh et al. (2019) noted that E-learning systems can be useful in subjects that theoretical teachings are more prominent in emergency intermediate technician. The results of their study showed that here were significant differences between the practical test scores (CPR, familiarity with the equipment, and proper patient transportation methods) in both the electronic and traditional methods, in all the skills except triage .
Virtual training is a new environment for learning that is able to overcome traditional education limitations. This method has no time or space limitations and is accessible to anyone who has a computer, tablet or Smartphone . Of note, in our study, of 140 eligible EMS staff, only 87 subjects participated in workshop. Individuals stated that shift working and busy schedule were the causes of their non-participation. Accordingly, we propose that instructors use the virtual education method as an alternative source for training especially for people who can't afford the time to take real courses.
Although, there was no significant difference between the practical tests scores in both the virtual and face-to-face training methods, practical group scored better than the virtual training group in all skills expect LMA when the post-test scores were compared. However, participating in workshop not only allows learner to have a one-on-one experience with the instructor and fail in a safe situation but also exposes them to practical skills that can be beneficial in which they will be working.
In the current research, it was shown that both groups had significantly higher results in the post-test, which reflects improving participants’ knowledge and skills performance through participating in workshop. Ghiyasvandian et al. in their study, similar to our results, showed that the experience of performing tracheal intubation correlated with successful tracheal intubation . Therefore, it can be said that the training and practice by the EMS staff is effective in improving their skills in performing tracheal intubation. Similar to the present study, Swanson et al. conducted a study to investigate the effect of training on ability of the participants in performing tracheal intubation at pre-hospital setting. They reported that education with practical training reduces failed tracheal intubation rate and resulted in successful tracheal intubation at the first attempt . Weisfeldt et al. stated that the correct and timely use of AED in patients before accessing hospital care saves lives of the patients and reduces the complications caused by cardiac arrest. They added that AED use training courses should be held continuously for pre-hospital EMS staff . Behmadi et al. also conducted a study to investigate the effect of the two methods of teaching lecture and virtual in teaching start triage lessons in emergency medical students. They concluded that that virtual can improve knowledge in undergraduate emergency student's education, but it is not superior to than traditional educational methods .
It is worthy to note that in Iran, the EMS personnel have different educational background such as nursing, operating room, anesthesia, and medical emergency technicians; therefore, they don't have the same level of knowledge and experience for pre-hospital care. So, holding training courses could provide the opportunity to practice and repeat and improving the skills and knowledge of the emergency staff.
Our study had some limitations such as sensitization of participants in both groups from intervention to post-test, use of related resources such as books and the Internet, communication of participants in work shifts and sharing opportunities, which could not be controlled by the researchers. In the virtual group, the participants received training as a CD containing the curriculum, and we had to trust them to track their use of the educational content; web-based virtual training programs could be used to solve this problem to control the presence of people in the training session.
Our results reflected the same effectiveness of both face-to-face and virtual methods in improving personnel performance in AED, tracheal intubation, LMA and CPR skills, so in cases where providing face-to-face training conditions is difficult, especially when the training is more theoretical, it is suggested to use virtual training methods as a complement to in-person training. Future studies are recommended to be performed in other healthcare groups such as nurses and operating room technicians. It is also suggested to compare the impact of CD-based methods with web-based methods.
Availability of data and materials
The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request, subject to ethical approval.
Emergency medical services
Laryngeal mask airway
Automatic external defibrillation
Continued medical education
Khankeh H, Akbari Shahrestanaki Y, Bahrampouri S, Beyramijam M. National Health-Oriented Hazard Assessment in Iran Based on the First Priority for Action in Sendai Framework for Disaster Risk Reduction 2015–2030. Emerg Med Int. 2021;2021:5593223.
Shojaei S, Mahdavi S, Mirtorabi S, Forouzesh M, Nazari SH. Descriptive epidemiology of road traffic mortality caused by heavy vehicles in Iran in 2018. Arch Trauma Res. 2021;10(2):97.
Eftekhari A, DehghaniTafti A, Nasiriani K, Hajimaghsoudi M, Fallahzadeh H, Khorasani-Zavareh D. Management of preventable deaths due to road traffic injuries in prehospital phase; a qualitative study. Arch Acad Emerg Med. 2019;7(1):32.
Whitehurst KE, Carraway M, Riddick A, Basnight LL, Garrison HG. Making the learning continuum a reality: the critical role of a graduate medical education–continuing medical education partnership. J Contin Educ Heal Prof. 2019;39(4):270–5.
Takahashi K, Wakasugi M, Okudera H, Seto C, Furuki I, Hasegawa T, Takahara S. Importance of continuing education for medical staff to improve the confirmation rate of intent for organ donation. Transplant Proc. 2019;51(10):3213-8.
Santarossa S, Kane D, Senn CY, Woodruff SJ. Exploring the role of in-person components for online health behavior change interventions: can a digital person-to-person component suffice? J Med Int Res. 2018;20(4):e8480.
Taveira-Gomes T, Ferreira P, Taveira-Gomes I, Severo M, Ferreira MA. What are we looking for in computer-based learning interventions in medical education? A systematic review. J Med Int Res. 2016;18(8):e204.
Park M, Jeong M, Lee M, Cullen L. Web-based experiential learning strategies to enhance the evidence-based-practice competence of undergraduate nursing students. Nurse Educ Today. 2020;91:104466.
Chang JY-F, Lin T-C, Wang L-H, Cheng F-C, Chiang C-P. Comparison of virtual microscopy and real microscopy for learning oral pathology laboratory course among dental students. J Dent Sci. 2021;16(3):840–5.
Boscolo-Berto R, Tortorella C, Porzionato A, Stecco C, Picardi EEE, Macchi V, et al. The additional role of virtual to traditional dissection in teaching anatomy: a randomised controlled trial. Surg Radiol Anat. 2021;43(4):469–79.
Wade SW, Moscova M, Tedla N, Moses DA, Young N, Kyaw M, et al. Adaptive tutorials versus web-based resources in radiology: a mixed methods analysis in junior doctors of efficacy and engagement. BMC Med Educ. 2020;20(1):1–12.
Peña-Fernández A, Acosta L, Fenoy S, Magnet A, Izquierdo F, Bornay FJ, et al. Evaluation of a novel digital environment for learning medical parasitology. Higher Educ Pedagog. 2020;5(1):1–18.
Du S, Liu Z, Liu S, Yin H, Xu G, Zhang H, et al. Web-based distance learning for nurse education: a systematic review. Int Nurs Rev. 2013;60(2):167–77.
Clark H, Bassett S, Siegert R. The effectiveness of web-based patient education and action and coping plans as an adjunct to patient treatment in physiotherapy: A randomized controlled trial. Physiother Theory Pract. 2019;35(10):930–9.
Barisone M, Bagnasco A, Aleo G, Catania G, Bona M, Scaglia SG, et al. The effectiveness of web-based learning in supporting the development of nursing students’ practical skills during clinical placements: A qualitative study. Nurse Educ Pract. 2019;37:56–61.
Kant R, Yadav P, Bairwa M. Effectiveness of the Internet-Based Versus Face-to-Face Interaction on Reduction of Tobacco Use Among Adults: A Meta-Analysis. Cureus. 2021;13(11):e19380.
Aminizadeh M. Comparing the effects of two different educational methods on clinical skills of emergency intermediate technician: A quasi-experimental research. J Educ Health Promot. 2019;8:54.
El-Ali A, Kamal F, Cabral CL, Squires JH. Comparison of traditional and web-based medical student teaching by radiology residents. J Am Coll Radiol. 2019;16(4):492–5.
Shaw T, Long A, Chopra S, Kerfoot BP. Impact on clinical behavior of face-to-face continuing medical education blended with online spaced education: a randomized controlled trial. J Contin Educ Heal Prof. 2011;31(2):103–8.
Brown G, Irving E, Keegan P. An introduction to educational assessment, measurement and evaluation: Pearson Education Auckland, NZ; 2008.
Frehywot S, Vovides Y, Talib Z, Mikhail N, Ross H, Wohltjen H, et al. E-learning in medical education in resource constrained low-and middle-income countries. Hum Resour Health. 2013;11(1):1–15.
Khatony A, Nayery ND, Ahmadi F, Haghani H, Vehvilainen-Julkunen K. The effectiveness of web-based and face-to-face continuing education methods on nurses’ knowledge about AIDS: a comparative study. BMC Med Educ. 2009;9(1):1–7.
Mahadevan SV, Walker R, Kalanzi J, Stone LT, Bills C, Acker P, et al. Comparison of Online and Classroom-based Formats for Teaching Emergency Medicine to Medical Students in Uganda. AEM education and training. 2018;2(1):5–9.
Wolf AB. The impact of web-based video lectures on learning in nursing education: An integrative review. Nurs Educ Perspect. 2018;39(6):E16–20.
Ghiyasvandian S, Khazaei A, Zakerimoghadam M, Salimi R, Afshari A, Mogimbeigi A. Evaluation of airway management proficiency in pre-hospital emergency setting; a simulation study. Emerg (Tehran). 2018;6(1):e58.
Swanson ER, Fosnocht DE. Effect of an airway education program on prehospital intubation. Air Med J. 2002;21(4):28–31.
Weisfeldt ML, Sitlani CM, Ornato JP, Rea T, Aufderheide TP, Davis D, et al. Survival after application of automatic external defibrillators before arrival of the emergency medical system: evaluation in the resuscitation outcomes consortium population of 21 million. J Am Coll Cardiol. 2010;55(16):1713–20.
Behmadi S, Asadi F, Okhovati M, Sarabi RE. Virtual reality-based medical education versus lecture-based method in teaching start triage lessons in emergency medical students: Virtual reality in medical education. J Adv Med Educ Prof. 2022;10(1):48.
The authors thank the Kermanshah University of Medical Sciences EMS staff who participated on the virtual or face-to-face based emergency medicine training in 2017. We also extend our thanks to clinical research development center of Imam Reza Hospital affiliated to Kermanshah University of Medical Sciences for their kind support.
This study was supported by a grant from the Vice Chancellery for Research and Technology, Kermanshah University of Medical Sciences (no grant:97087).
Ethics approval and consent to participate
Study protocol was approved by research ethics committee of Kermanshah University of Medical Sciences (IR.KUMS.REC.1396.669). The investigator explained to the participants the purpose, duration, and study procedures, potential benefits or risks involved with participation this study. This project was performed in accordance with the Declaration of Helsinki and the study researchers guaranteed confidentiality of their information. All participants signed the informed consent form.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Rad, R.F., Sadrabad, A.Z., Nouraei, R. et al. Comparative study of virtual and face-to-face training methods on the quality of healthcare services provided by Kermanshah pre-hospital emergency staff (EMS): randomized educational Intervention trial. BMC Med Educ 22, 203 (2022). https://doi.org/10.1186/s12909-022-03277-y
- Virtual training
- Face-to-face training
- Emergency medicine
- Clinical skills