This article has Open Peer Review reports available.
Effects of introducing a voluntary virtual patient module to a basic life support with an automated external defibrillator course: a randomised trial
© Kononowicz et al.; licensee BioMed Central Ltd. 2012
Received: 29 December 2011
Accepted: 18 June 2012
Published: 18 June 2012
The concept of virtual patients (VPs) encompasses a great variety of predominantly case-based e-learning modules with different complexity and fidelity levels. Methods for effective placement of VPs in the process of medical education are sought. The aim of this study was to determine whether the introduction of a voluntary virtual patients module into a basic life support with an automated external defibrillator (BLS-AED) course improved the knowledge and skills of students taking the course.
Half of the students were randomly assigned to an experimental group and given voluntary access to a virtual patient module consisting of six cases presenting BLS-AED knowledge and skills. Pre- and post-course knowledge tests and skills assessments were performed, as well as a survey of students' satisfaction with the VP usage. In addition, time spent using the virtual patient system, percentage of screen cards viewed and scores in the formative questions in the VP system throughout the course were traced and recorded.
The study was conducted over a six week period and involved 226 first year medical students. The voluntary module was used by 61 (54%) of the 114 entitled study participants. The group that used VPs demonstrated better results in knowledge acquisition and in some key BLS-AED action skills than the group without access, or those students from the experimental group deliberately not using virtual patients. Most of the students rated the combination of VPs and corresponding teaching events positively.
The overall positive reaction of students and encouraging results in knowledge and skills acquisition suggest that the usage of virtual patients in a BLS-AED course on a voluntary basis is feasible and should be further investigated.
Virtual patients (VPs) are computer simulations of real-life clinical scenarios created for the purpose of healthcare and medical training, education, or assessment . This concept encompasses a great variety of predominantly case-based e-learning modules with different complexity and fidelity levels . In two recent systematic literature reviews Cook and Triola proposed an agenda for research in the topic of VPs [3, 4]. One of the suggested themes was finding effective placement for VPs in the process of medical education. It is vital to know the right balance between computer-based learning (CBL) and non-computer instruction and the type of VP which best suits each group of learners.
Achieving and retaining competency in cardiopulmonary resuscitation is expected from healthcare providers at all levels of education. Methods are sought in order to improve resuscitation training . One possibility is to take advantage of the flexibility offered by e-learning technologies and thus provide students with an additional tool that could be used to prepare and rehearse for traditional face-to-face based classes in their spare time. The introduction of obligatory computer-aided methods at medical schools often meets with resistance in countries with low IT integration in the healthcare system. For that reason a gradual introduction whilst enhancing the curriculum with computer-based methods is preferred. On the other hand, it is possible that voluntary activities may be ignored by students or used unproductively.
In this study the effects of introducing a virtual patients module into an undergraduate course at Jagiellonian University are investigated. The research question is whether the addition of a non-obligatory virtual patient module is worth the effort in terms of improvements in students’ knowledge, skills and satisfaction.
The focus of our study was to examine the utilisation of VPs in the early stages of a medical curriculum to support a traditional (instructor-led) basic life support with automated external defibrillator (BLS-AED) course. A significant amount of evidence regarding the usage of CBL in basic life support (BLS) training is already available [6–10]. None of the studies of computer-aided BLS courses we were aware of focused on undergraduate students of medicine. The studies did not test the effects of the introduction of a web-based VP module on a voluntary basis into an existing curriculum. Hege et al. presented their findings from four self-study integration strategies of VPs in medical curricula (but not in BLS courses), these being a mixture of voluntary and obligatory case-based modules presented in addition to lectures and seminars . Their results did not contain any information about knowledge and skills acquisition by students. In a recent study Jensen et al. examined the effects of introducing a module of 40 VPs as a learning resource to retain competence acquired from an Advance Life Support course . A lack of social interaction in the e-learning programme was reported as significant barrier to using that module.
The innovation of our study is the broad perspective with which we investigate the outcome of voluntary use of VPs in the BLS-AED training for medical students. Both knowledge and skills improvements after a six week blended learning course are examined, including students’ satisfaction aspects.
Before the experiment began students were asked to acknowledge their willingness to participate in the study by signing a consent form. Anonymity of the study participants was ensured by a simple identity encoding system. The study was approved by the ethics committee of Jagiellonian University.
During the course students from the experimental group were granted access to a VP module on the CASUS® platform . The web-based VP shell developed by LMU University of Munich and Instruct AG has frequently been tested in large scale projects and studies in various medical fields [11, 14, 15]. The CASUS system enables the authoring of VP cases, course management, as well as the tracing of students' activities. All students were given technical instruction on how to use the CASUS platform and practised it several weeks before the study began in the Basics of Computer Science course, working for at least one hour on non-BLS relevant cases.
In order to evaluate the course's educational outcome, all students were tested in BLS-AED knowledge and skills before the course started and after the last meeting of the course. Both tests were unannounced.
The pre- and post-course knowledge tests consisted of 60 true-or-false BLS-AED questions, randomly selected from a pool of 120 questions verified by subject matter experts. The questions were randomised in order to impede the students from memorising them. For each correct answer one point was scored. Both tests were carried out using the Blackboard Academic SuiteTM system and were supervised by instructors to prevent students from communicating or using external knowledge sources while taking the test.
The pre- and post-course BLS-AED skills were evaluated using recommendations taken from the standardised Cardiff Test . Each student was given the same scenario: „You are in a shopping mall, suddenly you hear a noise and see a 60-year old woman who collapses in front of you. While falling she knocks a few tins from a shelf”. Additional information for the instructor was: (a) When the student shouts for help a helper immediately appears; (b) The victim is unconscious, not breathing and pulseless when checked; (c) On request AED is available at once. The scenario was terminated after three minutes, including about two minutes BLS time. In cases in which an AED was used the scenario was terminated after two minutes of BLS following first shock delivery. The initial rhythm was always shockable. At the end of their performance students were asked to list criteria for the termination of BLS. Chest compressions and ventilations were performed and recorded on Laerdal Resusci Anne Skill Reporter, on request students received the Powerheart AED G3 Semi Automatic training device by Cardiac Science.
Usage of virtual patient cases by students from the experimental group
60-year old male patient loses consciousness in supermarket
Learning Objectives: Recognition of the emergency and calling for help. Recovery position.
Sudden loss of consciousness of a 67-year old female patient
Learning Objectives: Management of the airway. Acute airway obstruction-manual thrusts. Artificial ventilation.
50-year old male patient unconscious
Learning Objectives: BLS algorithm. Chest compression and ventilation.
65-year old male patient loses consciousness in cinema
Learning Objectives: Automated External Defibrillation.
4-year old girl loses consciousness after choking
Learning Objectives:BLS-AED in children.
Resuscitation of a newborn
Learning Objectives: Resuscitation of newborns.
Student satisfaction was measured with questions from a survey proposed by Huwendiek et al. to evaluate curricular integration of VPs .
Statistical analysis was carried out using the Statsoft Inc., STATISTICA 10 package. A significance level α of 0.05 was chosen. Knowledge test results in the study groups were compared using ANOVA for repeated measures test. When a significant effect was found, post hoc comparisons with Newman-Keulus test were applied. Dichotomous results of skill assessment were analysed using χ 2 for 3×2 contingency tables. Effect size (ES) was calculated using Cohen’s d with pooled standard deviations. Correlation between data was checked with Spearman’s rank correlation coefficient.
All free-text opinions regarding VP integration given by students were carefully read. Using these opinions as its basis, a list of common themes was collated, keywords were assigned, and this was used to index the opinions. Based on the results, less frequent themes (n < 3) were excluded or merged to form more general one.
VP module usage
Out of the 226 students, 67(30%) had to be excluded from the study of knowledge acquisition for not taking the (unannounced) pre- or post-test (n = 61) or due to technical problems (computer breakdown, Internet connection failure, no study identifier given, n = 6 – Figure 2). This formed a sample of 159 students (G1: control group, n = 75; G2: experimental group deliberately not using VPs, n = 37; G3: experimental group using VPs n = 47 – Figure 2).
Pre- and Post-test results in BLS-AED knowledge
G1: n = 75
G2: n = 37
G3: n = 47
Pre-Test (mean/SD) [pts]
Post-Test (mean/SD) [pts]
No correlation was found between the total usage time of the VP module and post-test score (Spearman R = 0.17; p = 0.26), nor between the percentage of correct answers in the formative assessment in CASUS and the post-test score (Spearman R = 0.03; p = 0.83). However, a correlation between the percentage of screen cards viewed by students (completion rate) and their post-test score could be demonstrated (Spearman R = 0.33; p = 0.03).
From the group which was available for the knowledge acquisition study, 26 students had to be excluded at the stage of skills acquisition test due to not showing up at the skills assessment (n = 13), refusal to demonstrate their skills on a manikin (n = 7) or technical problems with the printer in the recording device (n = 6) – Figure 2.
Post-test results in BLS-AED skills
G1: n = 75
G2: n = 37
G3: n = 47
Safe approach performed
Arouse shout performed
Shake performed correctly
Shout for help performed
Open airway performed correctly
Check for signs of circulation correctly
Phone for help performed
Shout for AED
Start with chest compression
Correct identification of place for chest compression
Correct C:V Ratio (30:2)
Knows when to stop BLS
No unnecessary breaks during BLS
Average ventilation volume in [500–1000] ml
Average compression depth in [40–50] mm
If AED requested
n = 17
n = 9
n = 12
Safe use of AED:
Correct electrode pad placement
Students’ satisfaction with curricular integration of VPs
G3: n = 47
I felt well-informed about how the virtual patients were integrated into this course
The chronological order of the virtual patient work and the corresponding teaching events was well thought out.
The time spent on the virtual patients was well balanced with the time spent on the corresponding teaching events.
The content of virtual patients and the corresponding teaching events complemented each other well
The corresponding teaching events gave me an insightful learning experience, which I would not have had from the virtual patients alone.
I think that learning with the virtual patients is important in order to do well in the final exam for this course
I had easy access to the virtual patients at my convenience.
The teachers helped me to assess my learning during the corresponding teaching events
The teachers facilitated the further development of my clinical reasoning skills during the corresponding teaching events
The teachers were well prepared for the corresponding teaching events (incl. familiarity with the virtual patients).
I was actively involved in critically weighing pros and cons for explanations given by other students during the corresponding teaching events.
I was actively involved in applying my newly gained insights in clinical reasoning, during the corresponding teaching events
I was actively involved in refining my clinical reasoning skills during the corresponding teaching events.
The quality of discussion during the corresponding teaching events was good.
I felt secure enough to openly discuss even my shortcomings (e.g. my mistakes while working with virtual patients) during the corresponding teaching events.
I felt a positive climate for learning during the corresponding teaching events
I felt like part of a ‘community’ during the corresponding teaching events.
The combination of virtual patients and corresponding teaching events enhanced my clinical reasoning skills
The combination of virtual patients and corresponding teaching events made me feel better prepared to care for a real life patient with this complaint.
Overall, the combination of virtual patients and corresponding teaching events was a worthwhile learning experience.
Open-ended questions in the questionnaire formed an opportunity for the students to elaborate on their personal opinion on VPs themselves, as well as their integration into the course. About half of the students who used VPs stated in their free text opinions that the acquisition of knowledge from the e-learning module was easier for them than from books, and gave them new insights on problems discussed in traditional classes (n = 24). On the other hand, these opinions were partially balanced by other students stating their dislike of learning on-line (n = 4) or the overly complex login process (n = 11). One student stated that VPs were a good opportunity to prepare well for the final exams while instructor-led classes with manikins gave them more confidence to apply the knowledge in practice. Students identified as challenges facing VPs implementation: lack of confidence in VP efficacy expressed by some instructors from the faculty (n = 16), lack of time (n = 14), not enough information about the possibility of voluntary access of VPs (n = 13), the lack of good Internet access (n = 8) and the lack of on-line feedback given directly by teachers (n = 3). Surprisingly, some students criticised the fact that usage of the VP module was voluntary (n = 6), which had a negative impact on their motivation to use it. Among the advantages of the introduction of the VP module noticed by students were: flexibility of time and place of learning (n = 16), exam-relevance (n = 11), the possibility for self-assessment or to learn from errors (n = 11), practical usefulness (n = 10), belief in higher efficiency of this learning method in comparison to traditional learning methods (n = 6), multimedia content and the interactivity of the assignments (n = 5), the motivation to learn regularly (n = 3). One of the students summarised the VPs module advantages as: "you do not have to copy it, you cannot lose it, and it takes you just 10 minutes weekly".
The study was conducted in an actual university setting which shows students’ motivation to use a VP module better than it is possible in a more rigidly controlled artificial environment. It is definitely encouraging to notice that students from the intervention group using virtual patients were able to gain more from the course and scored better in the knowledge post-test than the control group. The voluntary participation percentage was much higher than that reported in voluntary courses by Hege at al.  but we have not investigated the reasons for this fact which could be the subject of a future study. A positive aspect of the instructor-led classes was that they gave the students the desired "social interaction" which is often missing in e-learning activities [12, 19, 20]. Worth stressing is the fact that the percentage of students correctly recognising a cardiac arrest victim was significantly higher in the experimental group than in the other groups. The lack of significant correlation between the amount of intervention and the score in the post-test can be explained by the fact that time spent on a screen card is only a very rough indicator of the thoroughness of a case session, and can be influenced by external factors like, for instance, learning in parallel from a text book, the presence of learning distractors or a slow Internet connection . Nevertheless, the demonstrated correlation between the percentage of screen cards viewed by students and their post-test score is again a very positive sign.
Based on our experience collected in the described implementation we would like to suggest that educators who plan to introduce new projects including virtual patients in the existing curriculum should focus on stimulation of students’ motivation to participate in the project. The first action appears to be initiation of the course with a dedicated pilot learning activity to show the students how to use the new software efficiently. In our case, this activity was combined with “basics of computer science” classes and was appreciated by course participants. Similar experiences can be found in recent literature [21, 22]. The second action concerns finding a way to make teachers more enthusiastic about promoting the additional learning activity to the students. The main challenge might be to fight the resistance and inertia towards new technology among faculty members, which in some cases could even be called technophobia . We believe that good integration of the VPs episodes with practical part of the course has the potential to increase motivation and strengthen the course continuum. As suggested by Hege et al., the exam relevance of the content also seems to be a good stimulus.
Some students indicated problems accessing VPs because of Internet connection or computer access limitations. The solution for that would be to enable the VP application to be displayed on mobile devices.
We also suggest making the login process as simple as possible. In our study the complex login procedure was caused by the need for anonymous identification of each student in order to compare pre- and post-test results with students activity in the VP system. However, this was recognised by students as significant barrier in the VP access. Despite the fact that every student should have received an e-mail about VPs, some of them complained about a lack of information about VP introduction. We suspect this could be caused by the rarely checked e-mail accounts provided in the project’s initiation phase, or by spam filters which were too sensitive. We were not using students' official university e-mail accounts since they were not often checked by students.
Beyond the scope of the study, but worth noticing, was data describing the quality of BLS-AED skills education in general. During post-course skills assessment only one-third of students asked for AED when faced with an unconscious, non-breathing person, which is an obvious improvement compared to the pre-course assessment in which nobody requested AED, however, 30% is still a very poor result. Also the BLS skills of students after the course did not in many cases meet the criteria concerning the correct depth of compressions and the quality of ventilation as defined by 2005 Resuscitation Guidelines . Similar poor results have also been obtained in other recent studies [6, 9]. This issue is currently undergoing further investigation.
One of the limitations of the study was surely the fact that a relatively large part of the experimental group (46%) did not use the e-learning module influencing the study design. This is, however, the inevitable consequence of the selected research question dealing with the voluntary use of VPs. It was outside the control of the authors to determine this percentage in advance to make the study subgroups more even in terms of the number of participants.
A major limitation with this sort of study that should be acknowledged, is that the students who accessed the VP resources were able to spend more time learning the subject, thus it is no surprise that they did better in the knowledge test. On the other hand, we have also no proof that students from the control group and the experimental group not using virtual patients did not study the subject in their spare time using methods other than virtual patients (e.g. information found on the Internet).
The observed effect size between the control group and the experimental group using virtual patients is 0.73. It needs to be recognised as a limitation of this study that this result may be affected by the volunteer bias effect since volunteers are usually more motivated to learn than other students . On the other hand, a comparison between the control group which surely included students willing to learn more in their free time and the experimental subgroup deliberately not using virtual patients showed no difference (45.8/46.1, p = 0.67). The control group was inferior to the merged experimental group containing both volunteers and those students who were not willing to use virtual patients (45.8/47.4, p = 0.01 in contrast analysis) but with an effect size of ES = 0.44.
Even though attempts were made to lessen interaction between control and experimental group members by randomization based on the students groups rather than individual students, their mutual influence cannot be excluded in the selected study design. This might have blurred the observed differences between the groups. The relatively high number of study drop-outs can be explained by the fact that the pre- and post-tests were unannounced and that the selected identity encoding method (based on selected letters from personal data known only by the students) was sometimes confusing for the study participants. When there was any doubt we preferred to exclude the participant from the study rather than to risk data inconsistency.
The overall positive response of students and encouraging results in knowledge and skills acquisition suggest that the usage of VP cases on a voluntary basis in a BLS-AED is feasible. The participants of the presented course clearly benefited from the additional module and the students approved this innovation and used it effectively. We anticipate an increase in coming years in the percentage of students able and eager to learn this way. A study is planned to analyse the factors which make students willing to participate in voluntary educational scenarios involving VPs and methods of increasing motivation to use VPs.
The CASUS system was in use at Jagiellonian University as part of the European project electronic Virtual Patients (eViP, ECP-2006-EDU-410030), courtesy of LMU University Munich. The authors wish to acknowledge their gratitude to Dr. Inga Hege from LMU University Munich for many fruitful discussions and support as well as the BLS-AED instructors and students from Jagiellonian University for their help in acquiring data. Some of the illustrations presented in virtual patients were used thanks to the courtesy of the Polish Resuscitation Council.
- Ellaway R, Poulton T, Fors U, McGee JB, Albright S: Building a virtual patient commons. Med Teach. 2008, 30: 170-174. 10.1080/01421590701874074.View ArticleGoogle Scholar
- Huwendiek S, de Leng BA, Zary N, Fischer MR, Ruiz JG, Ellaway R: Towards a typology of virtual patients. Med Teach. 2009, 31: 743-748. 10.1080/01421590903124708.View ArticleGoogle Scholar
- Cook DA, Triola MM: Virtual patients: a critical literature review and proposed next steps. Med Educ. 2009, 43: 303-311. 10.1111/j.1365-2923.2008.03286.x.View ArticleGoogle Scholar
- Cook DA, Erwin PJ, Triola MM: Computerized virtual patients in health professions education: a systematic review and meta-analysis. Acad Med. 2010, 85: 1589-1602. 10.1097/ACM.0b013e3181edfe13.View ArticleGoogle Scholar
- Perkins GD, Mancini ME: Resuscitation training for healthcare workers. Resuscitation. 2009, 80: 841-842. 10.1016/j.resuscitation.2009.06.013.View ArticleGoogle Scholar
- Monsieurs KG, Vogels C, Bossaert LL, Meert P, Manganas A, Tsiknakis M, Leisch E, Calle PA, Giorgini F: Learning effect of a novel interactive basic life support CD: the JUST system. Resuscitation. 2004, 62: 159-165. 10.1016/j.resuscitation.2004.02.014.View ArticleGoogle Scholar
- Moule P: Evaluation of the Basic Life Support CD-ROM: Its effectiveness and learning tool and user experiences. Educ Technol Soc. 2002, 5: 163-174.Google Scholar
- Moule P, Albarran JW, Bessant E, Brownfield C, Pollock J: A non-randomized comparison of e-learning and classroom delivery of basic life support with automated external defibrillator use: a pilot study. Int J Nurs Pract. 2008, 14: 427-434. 10.1111/j.1440-172X.2008.00716.x.View ArticleGoogle Scholar
- Reder S, Cummings P, Quan L: Comparison of three instructional methods for teaching cardiopulmonary resuscitation and use of an automatic external defibrillator to high school students. Resuscitation. 2006, 69: 443-453. 10.1016/j.resuscitation.2005.08.020.View ArticleGoogle Scholar
- de Vries W, Handley AJ: A web-based micro-simulation program for self-learning BLS skills and the use of an AED. Can laypeople train themselves without a manikin?. Resuscitation. 2007, 75: 491-498. 10.1016/j.resuscitation.2007.05.014.View ArticleGoogle Scholar
- Hege I, Kopp V, Adler M, Radon K, Mäsch G, Lyon H, Fischer MR: Experiences with different integration strategies of case-based e-learning. Med Teach. 2007, 29: 791-797. 10.1080/01421590701589193.View ArticleGoogle Scholar
- Jensen ML, Mondrup F, Lippert F, Ringsted C: Using e-learning for maintenance of ALS competence. Resuscitation. 2009, 80: 903-908. 10.1016/j.resuscitation.2009.06.005.View ArticleGoogle Scholar
- Fischer MR: CASUS – An authoring and learning tool supporting diagnostic reasoning. ZFHD. 2000, 1: 87-98.Google Scholar
- Fall LH, Berman NB, Smith S, White CB, Woodhead JC, Olson AL: Multi-institutional development and utilization of a computer-assisted learning program for the pediatrics clerkship: the CLIPP Project. Acad Med. 2005, 80: 847-855. 10.1097/00001888-200509000-00012.View ArticleGoogle Scholar
- Stark R, Kopp V, Fischer MR: Case-based learning with worked examples in complex domains: Two experimental studies in undergraduate medical education. Learn Instr. 2011, 21: 22-33. 10.1016/j.learninstruc.2009.10.001.View ArticleGoogle Scholar
- Whitfield RH, Newcombe RG, Woollard M: Reliability of the Cardiff Test of basic life support and automated external defibrillation version 3.1. Resuscitation. 2003, 59: 291-314. 10.1016/S0300-9572(03)00246-6.View ArticleGoogle Scholar
- Mayer RE: Applying the science of learning to medical education. Med Educ. 2010, 44: 543-549. 10.1111/j.1365-2923.2010.03624.x.View ArticleGoogle Scholar
- Huwendiek S, Haider HR, Tönshoff B, de Leng BA: Evaluation of curricula integration of virtual patients: Development of a student questionnaire and a reviewer checklist within the Electronic Virtual Patient (eViP) project. Bio-Algorithms and Med-Systems. 2009, 5: 35-44.Google Scholar
- Childs S, Blenkinsopp E, Hall A, Walton G: Effective e-learning for health professionals and students–barriers and their solutions. A systematic review of the literature–findings from the HeXL project. Health Info Libr J. 2005, 22 (Suppl 2): 20-32.View ArticleGoogle Scholar
- Cook DA: Web-based learning: pros, cons and controversies. Clin Med. 2007, 7: 37-42.View ArticleGoogle Scholar
- Hull P, Chaudry A, Prasthofer A, Pattison G: Optimal sequencing of bedside teaching and computer-based learning: a randomised trial. Med Educ. 2009, 43: 108-112. 10.1111/j.1365-2923.2008.03261.x.View ArticleGoogle Scholar
- Tsai CW: Involving students in a blended course via teacher's initiation in Web-enhanced collaborative learning. Cyberpsychol Behav Soc Netw. 2010, 13: 577-580. 10.1089/cyber.2009.0287.View ArticleGoogle Scholar
- Handley AJ, Koster R, Monsieurs K, Perkins GD, Davies S, Bossaert L: European Resuscitation Council guidelines for resuscitation 2005. Section 2. Adult basic life support and use of automated external defibrillators. Resuscitation. 2005, 67 (Suppl 1): s7-s23.View ArticleGoogle Scholar
- Callahan CA, Hojat M, Gonnella JS: Volunteer bias in medical education research: an empirical study of over three decades of longitudinal data. Med Educ. 2007, 41: 746-753. 10.1111/j.1365-2923.2007.02803.x.View ArticleGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6920/12/41/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.