This article has Open Peer Review reports available.
Puzzle based teaching versus traditional instruction in electrocardiogram interpretation for medical students – a pilot study
© Rubinstein et al; licensee BioMed Central Ltd. 2009
Received: 23 September 2008
Accepted: 13 January 2009
Published: 13 January 2009
Most medical professionals are expected to possess basic electrocardiogram (EKG) interpretation skills. But, published data suggests that residents' and physicians' EKG interpretation skills are suboptimal. Learning styles differ among medical students; individualization of teaching methods has been shown to be viable and may result in improved learning. Puzzles have been shown to facilitate learning in a relaxed environment. The objective of this study was to assess efficacy of teaching puzzle in EKG interpretation skills among medical students.
This is a reader blinded crossover trial. Third year medical students from College of Human Medicine, Michigan State University participated in this study. Two groups (n = 9) received two traditional EKG interpretation skills lectures followed by a standardized exam and two extra sessions with the teaching puzzle and a different exam. Two other groups (n = 6) received identical courses and exams with the puzzle session first followed by the traditional teaching. EKG interpretation scores on final test were used as main outcome measure.
The average score after only traditional teaching was 4.07 ± 2.08 while after only the puzzle session was 4.04 ± 2.36 (p = 0.97). The average improvement after the traditional session was followed up with a puzzle session was 2.53 ± 1.94 while the average improvement after the puzzle session was followed with the traditional session was 2.08 ± 1.73 (p = 0.67). The final EKG exam score for this cohort (n = 15) was 84.1 compared to 86.6 (p = 0.22) for a comparable sample of medical students (n = 15) at a different campus.
Teaching EKG interpretation with puzzles is comparable to traditional teaching and may be particularly useful for certain subgroups of students. Puzzle session are more interactive and relaxing, and warrant further investigations on larger scale.
The electrocardiogram (EKG) is a basic and commonly used diagnostic test in modern medicine. Most medical professionals are expected to possess basic EKG interpretation skills and as such it has become part of the curriculum for medical students undergoing their internal medicine rotations and training .
A review of the recent literature in the area of EKG interpretation has found the reading skills of interns , residents  and even attending physicians  in several specialties including internal medicine , family practice  and emergency medicine  are suboptimal and potentially deleterious to patient care . Furthermore, there are very few studies that have explored ways to improve EKG interpretation skills .
Most of these publications present varied time frames and teaching techniques and have had only marginal and non-sustained improvement in interpretation skills. Even studies that have looked into the addition of computer generated diagnosis and neural networks  have shown no improvement , minor improvement  and in some cases worsening  in diagnostic accuracy. Furthermore, the outcomes in these studies are not standardized and their results are difficult to implement .
The most current and exhaustive review on the subject states that there is no current evidence based criteria that improves and maintains EKG interpretation skills  and that further research is needed to clarify and improve the currently available methods , or devise a new method.
Traditional medical teaching aims to teach students by explaining the underlying mechanisms of disease through basic science learning, followed by disease categories and finally attempts to bring the learning together by demonstrating these mechanisms in patients . Alternatively, problem based learning (PBL) aims to teach the basic and clinical concepts of disease through the course of solving a clinical problem . Interestingly, neither method has been shown to improve the educational performance or EKG interpretation skills. It has been suggested that this is due to a lack of deeper understanding of the material presented and hence the prerequisite for successful transfer of medical information to relevant conceptual knowledge may be missing .
We have developed a puzzle (patent pending MSU ID 07-120) that attempts to improve the students overall understanding of the EKG and subsequently improve their interpretation skills. This tool is devised to encourage deductive reasoning and critical thinking instead of passive memorization of the material. The aim of the puzzle is to make the students active learners, and utilize their skills outside of the classroom to complement their knowledge base.
Similar approaches, such as card games  and simulations , have been shown to enhance students' level of understanding and ability to apply and synthesize material. This kind of self directed learning encourages the development of individualized and deeper understanding, and may produce physicians better prepared for lifelong education. PBL is a very popular instructional strategy and is particularly suitable for professional education . PBL exploit the merits of learner centered approach, and promotes deep, rather than surface learning [22, 23]. The traditional teaching approach is perceived as stressful by many students, and there is a need for novel methods to be used to encourage interactive teaching [23, 24]. Moreover, doctors with greater stress and emotional exhaustion during training have shown to be more disorganized in their approach in their practice, less satisfied with medicine as a career, and perceive their workplace climate as stressful environment with high workload .
We sought to compare EKG puzzle sessions with traditional teaching sessions in a group of medical students undergoing their medicine clerkship with standardized EKG tests. Furthermore, we evaluated their perceived stress response to both sessions.
Four groups of third year medical students (n = 15) undergoing their internal medicine clerkship rotation were offered the opportunity to participate in this study. The Institutional Review Board of Michigan State University approved the study and all participants gave written and informed consent to participate. All students participated and underwent their standard two-month clerkship and teaching with the added puzzle session. We also compared their final EKG scores with the scores of representative medical students (n = 15) from a different campus of the same school who underwent traditional teaching during same time period.
Prior to the course students were asked general information about their age, sex, prior exposure to EKG training (1 = none, 5 = significant) and how important they consider to be EKG interpretation in their career (1 = none to 5 = significant). At the conclusion of the final exam feedback was asked from the students by asking the following questions: 1. How useful was the teaching method (1 = not useful to 5 = very useful), 2. Was the method stressful (yes/no), 3. fun (yes/no), 4. time well spent (yes/no), 5. engaging (yes/no).
Outcome measure and scoring
Each test EKG was graded as per the university's protocol with a maximum of 10 points; five points for the correct diagnosis, one point each for rate, rhythm, axis, understanding of need for immediate attention and 0.5 points given for correctly measuring PR and QRS durations.
Each test included five EKGs with both sets standardized and consistent with each other. They were structured to test students capacity to diagnose sinus rhythm (n = 2), bundle branch blocks (n = 1), myocardial infarction (n = 1), and rhythm abnormalities (n = 1). The key for the exam was established by two senior cardiology fellows and was subsequently graded by a blinded physician.
Analysis was performed with Graph-Pad In-Stat 3.06 (GraphPad Software, San Diego, CA, USA). The groups were divided by their initial instruction method and two separate group scores were analyzed with the results presented as mean and standard deviation (SD) in parenthesis. The difference among these groups and between the initial and subsequent exam was also analyzed for mean and SD, and subsequently subjected to a two-sample Student's t-test for unequal variance to calculate p-values. A p-value < 0.05 was considered statistically significant.
Baseline characteristics of students
Average experience *
Importance of EKG interpretation in career *
Prior clinical (%)
Prior books (%)
There were five (55%) students that had an average score of less than five after the traditional teaching sessions. These students subsequently had an average improvement of 3.64 ± 1.03 after the puzzle session and their mean scores were not significantly different from those students that had an average score of greater than five after the traditional teaching. Three (50%) students had an average score less than 5 after their initial puzzle sessions and their scores improved after the traditional session by an average of 3.01 ± 1.48 (p = 0.28).
Diagnostic accuracy after first session and at final exam
Left Bundle Branch Block
Third Degree AV block
All students considered the traditional session's time well spent while 69% had the same opinion of the puzzle teaching. Furthermore, 46% considered the traditional method stressful while only 17% shared that opinion of the puzzle sessions. There was no difference in scores after the traditional sessions in those that considered the method stressful (4.1 ± 2.79) compared to those that did not (4.05 ± 1.1) (p = 0.48) or in those that considered the puzzle session stressful (4.7 ± 4.24) and those that did not (3.7 ± 1.68) (p = 0.39).
The final university EKG exam scores of this group of student from our campus (n = 15) to medical students (n = 15) was comparable to that of a similar group of students from a different campus who underwent a similar amount of traditional teaching sessions and were given the same exam (84.1 ± 6.25 vs. 86.6 ± 5.10, p = 0.22).
We have confirmed what most of the trials that we looked at stated in regards to the difficulty involved in teaching adequate EKG interpretation skills to medical students [2–9]. Even with the combined teaching modality, their average score was only 6.5, and a significant number had difficulty identifying common electrocardiographic diagnoses.
In this population of medical students, we did not detect any statistical improvement in EKG interpretation skills after either the traditional or the puzzle teaching. When we compared this group of students with a different contemporaneous group of students the scores were also comparable. However, a statistically significant difference would be difficult to find in light of the small sample size.
The puzzle sessions was helpful in the subgroup of students that did poorly after the traditional teaching showing an average improvement of 3.64 ± 1.03. This group included approximately half of the student population that was initially exposed to traditional teaching and potentially included students that did not recognize EKG patterns as easily as their colleagues but were able to obtain a correct EKG diagnosis through other mental mechanism. Unfortunately, we were not able to identify this subgroup of students by their perceived level of stress.
PBL  and self directed learning  have both been shown to improve outcomes in different teaching environments. The puzzle sessions incorporated several key points from these theories including letting the students take the initiative in the learning process, permitting the student to identify his and her own weaknesses, and permitting the individual to identify the diagnostic problem and look for an appropriate solution (or piece). We believe that part of the improvements seen in these cases were due to the application of these theories in a practical environment . Clearly, more research on a larger scale is required to further investigate these links and potential benefits.
The students that scored poorly after the puzzle session showed improvement after the traditional teaching, but they did not reach the same level of competency in comparison to the other students (5.8 vs. 7.35). This suggests that the students who underwent puzzle sessions first set their own learning goals, and generated a challenging educational environment before taking traditional teaching courses. Again, this emphasizes that non-traditional teaching is an effective way of delivering medical education in a coherent way and offers advantages over traditional teaching methods [20, 21]. Hence, individualizing EKG teaching with various methods available to the teacher may result in improved EKG interpretation skills.
All students thought that the traditional teaching method was useful and that the time well spent, even though it was considered to be stressful by some (46%). The puzzle session was considered useful by a significant number of students (69%) and was widely regarded as less stressful (17%). As pointed out earlier, increased stress level during physicians' training adversely affects their perceived level of job satisfaction and may decrease their capacity for deeper learning and understanding of complex ideas . Thus, the relaxed atmosphere of the puzzle session may have nurtured self directed problem based learning, and potentially improved the interpretation skills.
It has been shown that EKG interpretation accuracy improves with advancing years of training  and with further classes and lessons  and it is possible that the extra teaching with puzzle played a role in improving the final EKG scores. The puzzle sessions trended towards better initial scores and higher improvement in scores than traditional teaching but no trend proved to be statistically significant.
Strengths and weakness of the study
The limitations of this study include a small sample size from only one class of students from same university. Furthermore, it included exclusively medical students and was based on an experimental prototype of the teaching puzzle. We will be improving the initial prototype with changes to the design for clarity and correction of minor technical errors that were found during the testing. We will also apply this technique to other areas in medical training (student and registered nurses, family and internal medicine residents, etc.) and in other medical specialties to attempt to identify the groups that may benefit the most.
We have demonstrated that this different and novel teaching technique with puzzles is at least as useful as traditional EKG teaching and is more interactive and learner centered. It may be particularly useful for students that may learn more efficiently in relaxed environments that are more learner-centered.
This project was approved by the Institutional Review Board of Michigan State University.
An informed consent was obtained from each participant in the study.
We are indebted to Julie Randall for coordinating puzzle sessions and David Solomon, Ph.D. for his assistance throughout the project. We thank medical students of Michigan State University, East Lansing campus for participating in our study.
- CDIM-Society of General Internal Medicine (SGIM) Core Medicine Clerkship Curriculum Guide Version 3.0. [http://dev.im.org/Resources/Education/Students/Learning/Documents/OnlineCDIMCurriculum.pdf]
- Sur D, Kaye L, Mikus M, Goad J, Morena A: Accuracy of Electrocardiogram Reading by Family Practice Residents. Fam Med. 2000, 32 (5): 315-9.Google Scholar
- Margolis S, Reed R: EKG Analysis Skills of Family Practice Residents in the United Arab Emirates: A Comparison with US Data. Fam Med. 2001, 33 (6): 447-5.Google Scholar
- Jensen MSA, Thomsen JL, Jensen SE, Lauritzen T, Engberg M: Electrocardiogram interpretation in general practice. Family Practice. 2005, 22: 109-113. 10.1093/fampra/cmh601.View ArticleGoogle Scholar
- Berger JS, Eisen L, Nozad V, D'Angelo J, Calderon Y, Brown DL, Schweitzer P: Competency in electrocardiogram interpretation among internal medicine and emergency medicine residents. Am J Med. 2005, 118 (8): 873-880. 10.1016/j.amjmed.2004.12.004.View ArticleGoogle Scholar
- Boltri JM, Hash RB, Vogel RL: Are Family practice residents able to interpret electrocardiograms?. Advances in Health Sciences Education. 2003, 8: 149-153. 10.1023/A:1024943613613.View ArticleGoogle Scholar
- Hoyle RJ, Walker KI, Thomson G, Bailey M: Accuracy of electrocardiogram interpretation improves with emergency medicine training. Emergency Medicine Australia. 2007, 19: 143-150. 10.1111/j.1742-6723.2007.00946.x.View ArticleGoogle Scholar
- Larson DM, Mensenn KM, Sharkley SW: "False-Positive" Cardiac Catheterization Laboratory Activation among Patients with Suspected ST-Segment Elevation Myocardial Infarction. JAMA. 2007, 298 (23): 2754-2760. 10.1001/jama.298.23.2754.View ArticleGoogle Scholar
- Pahlm US, O'Brien JE, Patterson J, Pahlm O, White T, Maynard C, Wagner GS: Comparison of teaching the basic electrocardiographic concept of frontal plane QRS axis using the classical versus the orderly electrocardiogram limb lead displays. Am Heart J. 1997, 134 (6): 1014-1018. 10.1016/S0002-8703(97)70020-6.View ArticleGoogle Scholar
- Holst H, Ohlsson M, Peterson C, Pahlm O, White T, Maynard C, Wagner GS: A confident decision support system for interpreting electrocardiograms. Clinical Physiology. 1999, 19 (5): 410-418. 10.1046/j.1365-2281.1999.00195.x.View ArticleGoogle Scholar
- Hongo Rh, Goldschlager N: Overreliance on computerized algorithms to interpret electrocardiograms. Am J Med. 2004, 117: 706-708. 10.1016/j.amjmed.2004.08.006.View ArticleGoogle Scholar
- De Brone MC, Kors JA, Hoes AW, Kruijssen DA, Deckers JW, Grosfeld M, van Herpen G, Grobbee DE, van Bemmel JH: Diagnostic interpretation of electrocardiograms in population-based research: Computer program research physicians or cardiologist?. J Clin Epidemiol. 1997, 50 (8): 947-952. 10.1016/S0895-4356(97)00100-5.View ArticleGoogle Scholar
- Tsai TL, Fridsma DB, Gatti G: Computer decision support as a source of interpretation error: the case of electrocardiograms. J Am Med Inform Assoc. 2003, 10: 478-483. 10.1197/jamia.M1279.View ArticleGoogle Scholar
- Peterson S: Time for evidence based medical education. BMJ. 1999, 318 (7193): 1223-4.View ArticleGoogle Scholar
- Salerno SM, Alguire PC, Waxman HS: Training and competency evaluation for interpretation of 12-lead electrocardiograms: Recommendations from the American College of Physicians. Ann Intern Med. 2003, 138 (9): 747-750.View ArticleGoogle Scholar
- Salerno SM, Alguire PC, Waxman HS: Competency in interpretation of 12-lead electrocardiograms: a summary and appraisal of published evidence. Ann Intern Med. 2003, 138: 751-760.View ArticleGoogle Scholar
- Hatela RM, Brooks LR, Norman GR: Practice makes perfect: The critical role of mixed practice in the acquisition of ECG interpretation skills. Adv Health Science Ed. 2003, 8: 17-26. 10.1023/A:1022687404380.View ArticleGoogle Scholar
- Norman GR, Schmidt HG: The psychological basis of problem based learning. Academic Medicine. 1992, 67: 557-565.View ArticleGoogle Scholar
- Bransford JD, Brown AL, Cocking RR: How people learn: Brain, mind, experience and school. 1999, National Academy Press, Ch 3: 51-78.Google Scholar
- Odenweller CM, Hsu CT, DiCarlo SE: Educational card games for understanding gastrointestinal physiology. Am J Physiol. 1998, 275 (6 Pt 2): S78-84.Google Scholar
- Gordon JA, Shaffer DW, Raemer DB, Pawlowski J, Hurford WE, Cooper JB: A randomized controlled trial of simulation-based teaching versus traditional instruction in medicine: a pilot study among clinical medical students. Adv Health Sci Educ Theory Pract. 2006, 11 (1): 33-9. 10.1007/s10459-004-7346-7.View ArticleGoogle Scholar
- Wood DF: Problem based learning. BMJ. 2008, 336 (7651): 971-10.1136/bmj.39546.716053.80.View ArticleGoogle Scholar
- Spencer JA, Jordan RK: Learner centered approaches in medical education. BMJ. 1999, 318: 1280-83.View ArticleGoogle Scholar
- McManus IC, Keeling A, Paice E: Stress, burnout and doctors' attitudes to work are determined by personality and learning style: a twelve year longitudinal study of UK medical graduates. BMC Med. 2004, 2: 29-10.1186/1741-7015-2-29.View ArticleGoogle Scholar
- Dolmans D, Schmidt H: The advantages of problem based curricula. Postgrad Med. 1996, 72: 535-8. 10.1136/pgmj.72.851.535.View ArticleGoogle Scholar
- Chastonay P, Brenner E, Peel S, Guilbert J-J: The need for more efficacy and relevance in medical education. Med Educ. 1996, 30: 235-8.View ArticleGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6920/9/4/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.