This article has Open Peer Review reports available.
A study to investigate the effectiveness of SimMan® as an adjunct in teaching preclinical skills to medical students
© Swamy et al.; licensee BioMed Central Ltd. 2014
Received: 28 February 2014
Accepted: 9 September 2014
Published: 19 November 2014
Following the GMC’s report on Tomorrow’s Doctors, greater emphasis has been placed on training in clinical skills, and the integration of clinical and basic sciences within the curriculum to promote the development of effective doctors. The use of simulation in the learning environment has the potential to support the development of clinical skills in preclinical medical students whilst in a ‘safe’ environment, but currently there is little evidence on its effectiveness.
Seventy nine year one medical students were divided into two groups. A pre-test was conducted by both groups, after which one group performed chest examination on their peers whilst the other group examined the SimMan® manikin. Both groups subsequently performed a mid-test and crossed over so that the group that conducted peer examination examined the manikin and vice-versa. Finally a post-test was conducted. The students were scored for formative feedback whilst performing examinations. Students completed a feedback questionnaire at the end of the session. Data were analysed using a one-way ANOVA, independent t-test and 2- proportion Z test.
When the two groups were compared, there was no significant difference in their pre-test and post-test knowledge scores, whereas mid-test knowledge scores increased significantly (P < 0.001), with the group using SimMan® initially scoring higher. A significant increase in the test scores was seen in both groups after using SimMan® (P < 0.001). Students’ confidence increased significantly in differentiating between normal and abnormal signs (P < 0.001). Students highly valued the use of the manikin in the session with 96% of students reporting that it enhanced their learning experience.
The study demonstrated a significant improvement in the students’ knowledge after examining the manikin and students also reported an increase in their confidence. Students’ feedback was generally very positive and they perceived the incorporation of manikin-based examinations useful to prepare them for future patient contact. The use of simulation in this context supports an integrated learning approach when used as an adjunct to peer examination, and can benefit the acquisition of clinical skills in preclinical medical students.
Over recent years, the early introduction of clinical skills teaching, and the integration of patient-focused clinical and basic sciences, has gained greater importance in undergraduate medical education. At Durham University, first and second year medical students practice clinical skills on each other under direct supervision from tutors, and receive immediate feedback on their performance during the clinical skills training sessions. They are introduced to a range of generic clinical skills, such as communication, clinical examination, and practical procedures, all of which are assessed during the summative Objective Structured Clinical Examinations (OSCEs). Students are trained so that they can subsequently perform these skills competently and confidently on patients. However, the challenges faced by preclinical students (Phase 1 medical students) are that they must learn and develop these clinical skills with limited exposure to patients, and also be able to apply these skills appropriately when they move on to clinical rotations. Several studies have documented that this transition from preclinical to clinical phases is stressful for medical students [1–4]. One of the areas in which both students and instructors feel there are difficulties is in the competent performance of clinical skills at an early stage in their clinical rotations .
Simulation-based education is seen to supplement the clinical education of medical students in a safe and supportive manner. It is a rapidly developing area which provides the learner with opportunities to repetitively practice, develop and transfer clinical skills without any fear of harm to patients, in a controlled setting. It is being used to augment learners’ knowledge and help them shape the acquisition of clinical skills [5–8]. Although simulation does not exactly duplicate clinical challenges or experiences with real patients in a genuine clinical setting, it complements students’ learning, and literature suggests that it can be used to prepare students for contact with real patients .
Laerdal SimMan® , a moderate fidelity manikin, is currently used widely in the later years of medical education. Students have evaluated its use positively in a number of studies, such as teaching undergraduate medical students in the context of management of medical emergencies [10–12], and the development of preclinical skills . It provides learners with the opportunity to experience a learning environment as close as possible to clinical practice by providing physical representations of patients. It gives them the benefit of exposure to pathological states with the holistic experience of examining and treating a patient, without exposing them to real patients. Thus it can be used to bridge the gap between preclinical and clinical settings.
The aim of the study was to explore the role of SimMan® as an adjunct to peer examination in the teaching of clinical skills to preclinical medical students.
Ethical approval was obtained from the School of Medicine, Pharmacy and Health, Durham University (ESC2/2013/PP003).
One hundred and four first year medical students at Durham University were invited to participate, of which seventy nine students volunteered and were included in the study. All students were taught the clinical skills of respiratory and cardiovascular system examination, and had previously performed these examinations on their peers.
Clinical conditions with corresponding signs used in the study
Chronic obstructive pulmonary disease
Increased respiratory rate, cyanosis and wheezy coarse crackles
Pulmonary regurgitation with atrial fibrillation
Murmur, irregular pulse and increased heart rate
Anonymized data was analyzed with specific statistical analyses, described within the results for each stage of the study. Quantitative data was analyzed using a one-way ANOVA and an Independent t-test. Qualitative data from confidence questions were analyzed using a 2-proportion Z test and Fischer’s exact test. A P-value < 0.05 was considered statistically significant in all tests. Qualitative data from the free text comments on feedback questionnaires was analyzed using thematic analysis. From the free text comments, the relevant data was coded into themes for each of the questions. Two authors (MSw and MS) independently coded the data and any differences were then discussed to reach an agreement.
Knowledge test scores from Group A (Group using peer examination initially) and Group B (Group using SimMan® initially)
Statistical analysis (one-way ANOVA) indicated that there was a significant difference between the pre-test and mid-test scores of Group B (F = 27.120, P < 0.001) and between mid-test and post-test of Group A (F = 39.857, P < 0.001). Further analysis (Independent t-test) confirmed that there was a significant increase in the mid-test scores (after performing examination on the manikin) when compared with the pre-test scores in the Group B (Independent t-test, t = 6.354, P < 0.001). In addition, post-test scores (after performing examination on the manikin) of Group A were significantly higher when compared with mid-test scores (Independent t-test, t = 6.928, P < 0.001) in the Group A. Thus students scored higher in the knowledge test after examining the manikin when compared to students who performed the examination on each other.
Performance scores during chest examination
SimMan® (Mean ± SD)
Peer examination (Mean ± SD)
14.85 ± 2.94
15.87 ± 4.39
P = 0.22
13.33 ± 4.01
16.43 ± 2.93
P < 0.001
The mean confidence increased from the pre-test to mid-test, and then further increased in the post-test for both groups. The number of students who were confident in examining a patient increased significantly after examining their peers when compared to those after performing examination on the manikin, for both groups [Group A, pre-test (15) vs. mid-test (27), P = 0.007 and Group B, mid-test (18) vs. post-test (31), P <0.001)]. Students in both groups felt that they were more confident in differentiating between normal and abnormal signs after performing examination on the manikin [Group A, mid-test (13) vs post- test (28), P = 0.02 and Group B, pre-test (3) vs. mid-test (19), P <0.001)], but were more confident at performing examination in a clinical setting after peer examination [Group A, pre-test (4) vs. mid-test (24), P < 0.001 and Group B, mid-test (24) vs. post-test (33), P = 0.01)].
Evaluation results of students’ feedback questionnaire
1. I feel the use of SimMan® to practice examination was useful
2. SimMan® improved my knowledge for performing examination
3. SimMan® reinforced the importance of being able to recognize normal findings
4. I received useful feedback on my performance
5. The session which included both SimMan® and peer examination enhanced my learning experience
6. The session which included both SimMan® and peer examination made me feel more prepared to examine real patients
7. The session was enjoyable
I feel the use of SimMan® to practice examination was useful. Please state why?
Students who responded positively:
Abnormal signs and external equipment useful
“It was really helpful to hear/feel what was abnormal which I wouldn’t necessarily be able to do with my fellow students comparison”
“Allows you to examine abnormalities at this early stage. Being able to hear abnormal findings allows you to better recognise normal”
“Was good practise, useful as well seeing the monitors and dealing with clinical signs”
“It is useful to examine in a more clinical context, with issues occurring around SimMan and to listen to abnormal sounds”
Improved clinical contextualisation
“It was realistic and placed me in a clinical like scenario. It allows me to challenge myself with a new setting”
“It is useful to examine in a more clinical context, with issues occurring around SimMan and to listen to abnormal sounds”
“He is able to simulate real life abnormal patients which is very useful for our hospital practice.”
Increased perceived level of confidence
“I couldn’t remember any examination procedure but after the SimMan session I am more confident when carrying out the real patient examination”
“Improved my confidence in examining a patient. It showed me what to expect when looking and listening for abnormalities”
Absence of realism
“It’s not a real patient and so if you get it wrong there’s no shame”
“Freedom to palpate”
“Also not the shyness/inhibitions associated with friends”
“Being able to examine a patient that isn’t a peer. It makes the experience more
“Very clear clinical signs and easier to examine than a real patient because I was less nervous”
Students with negative/neutral response:
Absence of realism
“Otherwise the lack of interaction with the patient makes it difficult. Also SimMan is immobile which makes examination awkward”
“but it was difficult to practice communication skills”
“It was intimidating and could not perform a full examination e.g. cap refill, clubbing which threw me and I panicked. There is no interaction with the ‘patient’.”
“The stats monitor was good but otherwise can’t recreate human experience.”
“It was difficult to imagine he was a real patient. And doing the normal tests – checking for clubbing was difficult as unrealistic”.
Lack of exposure
SimMan® improved my knowledge for performing examination. Please state why?
Students with positive response:
Learnt about abnormal signs
“It improved my knowledge of what heart murmurs and wheezing sounded like”
“He allowed us to hear what abnormal heart and lung sounds sounded like”
“I feel I’d be better at identifying abnormal”
“There’s some clinical knowledge we haven’t been taught but I picked them up during the SimMan® session.”
Interpret monitor parameters
“I actually got to clearly relate my findings to the monitor’s data e.g. I linked heart value auscultation with an ECG”.
“Also importance of taking pulse even though got it on a screen.”
“Getting feedback on how to examine a non-healthy person – sometimes you can’t do the same things”
Prepared students for future patient contact
Students with negative/neutral response:
Other methods were as good or better
“ It showed me what to expect when looking and listening for abnormalities”
“Enabled me to understand the difficulties of performing CVR and respiratory examinations on more critically ill patients”
“The setting was like in a hospital. The SimMan has oxygen mask attached and he can be programmed to have simulated clinical problems. This allows me to understand the difference between normal and abnormal”
“For abnormal knowledge it was good but the rest could be taught in either setting”
“Not the same as a real person but useful to hear/feel abnormalities”
Lack of exposure
“Interesting, but I feel it would be more useful with continued exposure since a one-time exposure to clinical settings is intimidating more than it is useful”
The session which included both SimMan® and peer examination enhanced my learning experience. Please state why?
The majority of the students agreed or strongly agreed that the session which included both the manikin and peer examination enhanced their learning experience. The remaining students were unsure.
“Best of both worlds”
Students found the experience of examining in different settings useful as there was deliberate practice and feedback on performance, it encouraged reflection and identified areas of improvement whist providing an opportunity to examine and identify normal and abnormal signs. Some students commented that it helped them remember the examination procedure/steps better, improved the appreciation of the importance of clinical examinations, increased confidence, encouraged checking for abnormality, and provided useful revision.
“ Either alone has limitations but together they cover everything ”
“SimMan as it was really realistic”
“Use of SimMan to see abnormalities as it simulates reality in a pretty accurate manner”
“More exciting to investigate abnormalities, however this may be due to novelty”
However, some students disliked the absence of realism in SimMan®.
“Difficult to show empathy”
It was interesting to note that one student commented, “Cannot replace real patient contact but it’s the next best thing” and another student felt “SimMan’s clinical setting portrayed was more accurate but is intimidating rather than useful unless it is repeated”.
The session stimulated students’ interest in recognising abnormalities, working with simulated patients, revision and clinical skills/practice.
“Very enjoyable. Recommend for next year”
“Using peer examination and SimMan® is the best way forward, provides different things”
“Integrate into OSCE”
In this study we have compared two teaching modalities - peer examination and examination using SimMan®. It was found that students’ knowledge required to perform respiratory and cardiovascular examination improved significantly after they performed examination on the manikin. However, it is interesting to note that repeated exposure to peer examination did not improve students’ knowledge. In addition, the manikin was as effective as peer examination in increasing students’ confidence. These findings are similar to other studies that have reported an improvement in preclinical medical students’ knowledge and confidence after simulation [12, 13]. We found a significant increase in students’ knowledge after examining the manikin in both groups whereas in the study conducted by Swamy et al. , there was a similar, non-significant trend in the group initially using peer examination. One of the advantages of simulation is that it allows application of theoretical knowledge to practice . When students perform examination on each other, they become familiar with normal examination findings but they are aware that they are examining a healthy person. SimMan®, on the other hand provides students with the variability of examining both normal and abnormal clinical signs, which reflects more closely what they are likely to encounter in clinical practice. During examination this encourages students to actually look for signs rather than just comment that they were either present or absent. The manikin provides them with the opportunity to apply their knowledge and thus reinforces normal findings; focusing them towards looking for abnormalities or deviations from normal. One student aptly summarised this, saying “I was able to explore the abnormal and know the abnormality. In peer examination normal is always ‘assumed’ rather than checked. SimMan® you don’t know for sure that you are examining a normal patient”. Hence most students found the manikin useful for practicing examination and felt that it added clinical contextualisation.
Students felt that the manikin improved their knowledge because they not only learnt about abnormal findings but also were provided with an opportunity to apply knowledge and interpret clinical signs, thus reiterating the knowledge required to examine a patient. Students also considered the feedback they received to be useful. Students felt they were more aware of the issues around examining a patient after examining the manikin. We found that the number of students who reported they were confident increased significantly for differentiating between normal and abnormal clinical signs after simulation whereas this decreased for examining a patient in a clinical setting. It may be that examining in a new setting without previous exposure to the modality, and having to recall steps, apply their knowledge and to be able to explore abnormalities, can be challenging to students.
SimMan® has drawbacks during examination. Students are not able to communicate as effectively as they would with a live subject. Also when using the manikin some aspects of the examination cannot be performed, for example, the head of the manikin cannot be turned when looking for JVP, neither can the wrist be bent to examine for flapping tremors, hence some students gave negative responses for using the manikin to practice examination. Some students specifically commented that it impacted negatively because they were examining the manikin for the first time. This may explain why students scored higher during peer examination when compared to examining the manikin. In the study by Swamy et al. in 2013 , it was found that graduate-entry students scored higher or equal to peer examination whilst performing chest examination on the manikin. This could be because they were mature students and thus the drawbacks felt by the students of examining the manikin were not as much of a hindrance. However, some students were less stressed because there was no shame or shyness or inhibition that may be associated with examining peers or patients. Students suggested that the session could be improved by increasing the time allocated, providing more teaching, and increasing the number of stations. They recommended frequent use of the manikin. Although SimMan® and other simulators like Harvey® and Ventriculoscope have their own advantages and disadvantages, SimMan® provides a more realistic and holistic experience of examining a patient .
Learners’ engagement with the repetitive practice of skills and assessment with specific informative feedback in a controlled setting has been shown to help in the acquisition of expertise . Students evaluated the session incorporating both peer and SimMan® very positively. Together they can establish a strong foundation of clinical skills through experiential learning which can eventually be developed in clinical practice. Also it prepares students for future encounters with the manikin which is likely to increase in medical training, and helps them to acquire advanced clinical skills without having any negative impact on their learning experience at that stage.
Some limitations of this study include the fact that this is a carried out with a single cohort of medical students from a single school. SimMan®, a simulated patient cannot replace the learning experience that is derived from real patients in clinical practice. But, providing real patients may not be practical in preclinical years with respect to feasibility, accessibility and availability . However, it encourages learning in an environment that does not compromise patient safety and can be useful to prepare students for clinical practice.
The manikin provides students with an opportunity to experience examining patients during their early years of training. It reinforces the importance of eliciting normal findings and helps application of knowledge and skills in a safe environment. The findings of this study show that the manikin can be used as an adjunct in facilitating the acquisition of clinical skills during the early years of training as it improves students’ knowledge and confidence. The majority of the students found it useful to practice examination. It can be used to formatively assess student performance. Thus, an integrated learning approach using SimMan® as an adjunct to peer examination can benefit preclinical medical students’ ability to acquire clinical skills.
The authors thank Mrs Alison Bradley and Mrs Pamela Stasiak, Durham University for their technical support in conducting the session.
- O’Brien B, Cooke M, Irby DM: Perceptions and attributions of third-year student struggles in clerkships: Do students and clerkship directors agree?. Acad Med. 2007, 82 (10): 970-978. 10.1097/ACM.0b013e31814a4fd5.View ArticleGoogle Scholar
- Moss F, McManus I: The anxieties of new clinical students. Med Educ. 1992, 26: 17-20. 10.1111/j.1365-2923.1992.tb00116.x.View ArticleGoogle Scholar
- Radcliffe C, Lester H: Perceived stress during undergraduate medical training: a qualitative study. Med Educ. 2003, 37: 32-38. 10.1046/j.1365-2923.2003.01405.x.View ArticleGoogle Scholar
- Mosley TH, Perrin SG, Neral SM, Dubbert PM, Grothues CA, Pinto BM: Stress, coping, and well-being among third-year medical students. Acad Med. 1994, 69: 765-767. 10.1097/00001888-199409000-00024.View ArticleGoogle Scholar
- Issenberg SB, McGaghie WC, Petrusa ER, Gordon DL, Scalese RJ: Features and uses of high-fidelity medical simulations that lead to effective learning: a BEME systematic review. Med Teach. 2005, 27 (1): 10-28. 10.1080/01421590500046924.View ArticleGoogle Scholar
- Ewy GA, Felner JM, Jull D, Mayer JW, Sajid AW, Waugh RA: Test of a cardiology patient simulator with students in fouth-year electives. J Med Educ. 1987, 62 (9): 738-743.Google Scholar
- Gordon MS, Evy GA, DeLeon AC, Waugh RA, Felner JM, Forker AD, Gessner IH, Mayer JW, Patterson D: “Harvey”, the cardiology patient simulator: pilot studies on teaching effectiveness. Am J Cardiol. 1980, 45 (4): 791-796. 10.1016/0002-9149(80)90123-X.View ArticleGoogle Scholar
- Karnath B, Frye AW, Holden MD: Incorporating simulators in a standardized patient exam. Acad Med. 2002, 77 (7): 754-755. 10.1097/00001888-200207000-00046.View ArticleGoogle Scholar
- Laerdal: [http://www.laerdal.com/gb/SimMan3G#/Specifications]
- MacDowall J: The assessment and treatment of the acutely ill patient–the role of the patient simulator as a teaching tool in the undergraduate programme. Med Teach. 2006, 28 (4): 326-329. 10.1080/01421590600625130.View ArticleGoogle Scholar
- Weller JM: Simulation in undergraduate medical education: bridging the gap between theory and practice. Med Educ. 2004, 38 (1): 32-38. 10.1111/j.1365-2923.2004.01739.x.View ArticleGoogle Scholar
- Halm BM, Lee MT, Franke AA: Improving medical student toxicology knowledge and self-confidence using mannequin simulation. Hawaii Med J. 2010, 69 (1): 4-7.Google Scholar
- Swamy M, Bloomfield TC, Thomas RT, Singh H, Searle FS: Role of SimMan® in teaching clinical skills to preclinical medical students. BMC Med Educ. 2013, 13: 20-10.1186/1472-6920-13-20.View ArticleGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6920/14/231/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.