- Research article
- Open Access
Effectiveness of blended learning versus lectures alone on ECG analysis and interpretation by medical students
BMC Medical Education volume 20, Article number: 488 (2020)
Most medical students lack confidence and are unable to accurately interpret ECGs. Thus, better methods of ECG instruction are being sought. Current literature indicates that the use of e-learning for ECG analysis and interpretation skills (ECG competence) is not superior to lecture-based teaching. We aimed to assess whether blended learning (lectures supplemented with the use of a web application) resulted in better acquisition and retention of ECG competence in medical students, compared to conventional teaching (lectures alone).
Two cohorts of fourth-year medical students were studied prospectively. The conventional teaching cohort (n = 67) attended 4 hours of interactive lectures, covering the basic principles of Electrocardiography, waveform abnormalities and arrhythmias. In addition to attending the same lectures, the blended learning cohort (n = 64) used a web application that facilitated deliberate practice of systematic ECG analysis and interpretation, with immediate feedback. All participants completed three tests: pre-intervention (assessing baseline ECG competence at start of clinical clerkship), immediate post-intervention (assessing acquisition of ECG competence at end of six-week clinical clerkship) and delayed post-intervention (assessing retention of ECG competence 6 months after clinical clerkship, without any further ECG training). Diagnostic accuracy and uncertainty were assessed in each test.
The pre-intervention test scores were similar for blended learning and conventional teaching cohorts (mean 31.02 ± 13.19% versus 31.23 ± 11.52% respectively, p = 0.917). While all students demonstrated meaningful improvement in ECG competence after teaching, blended learning was associated with significantly better scores, compared to conventional teaching, in immediate (75.27 ± 16.22% vs 50.27 ± 17.10%, p < 0.001; Cohen’s d = 1.58), and delayed post-intervention tests (57.70 ± 18.54% vs 37.63 ± 16.35%, p < 0.001; Cohen’s d = 1.25). Although diagnostic uncertainty decreased after ECG training in both cohorts, blended learning was associated with better confidence in ECG analysis and interpretation.
Blended learning achieved significantly better levels of ECG competence and confidence amongst medical students than conventional ECG teaching did. Although medical students underwent significant attrition of ECG competence without ongoing training, blended learning also resulted in better retention of ECG competence than conventional teaching. Web applications encouraging a stepwise approach to ECG analysis and enabling deliberate practice with feedback may, therefore, be a useful adjunct to lectures for teaching Electrocardiography.
The incorrect interpretation of an electrocardiogram (ECG) may lead to inappropriate clinical decisions with adverse outcomes [1, 2]. Although computerised ECG diagnostic algorithms are available, these are frequently not accurate and clinicians should therefore not rely on these automated ECG interpretations [3,4,5,6]. ECG interpretation is thus an essential learning outcome in undergraduate medical curricula [7, 8]. The concern is that medical students around the world lack competence and confidence in ECG analysis and interpretation [9,10,11,12,13,14]. For this reason, it is important to review the way that Electrocardiography has been conventionally taught.
With the widespread availability of computers and the Internet, contemporary health professions’ education increasingly uses e-learning to supplement classroom-based teaching such as lectures [15, 16]. In Electrocardiography, computer-assisted instruction (CAI) dates back to the 1960’s when analogue computers were used to teach ECGs to medical students . However, since the turn of the millennium, web-based learning has been increasingly used as a method of ECG instruction . Recent work has shown that an online programme facilitating repeated ECG interpretation with deliberate practice and feedback enhanced learning . Although web-based learning has previously been shown to be at least as effective as conventional methods of instruction in health sciences , e-learning on its own has not conclusively been shown to be more effective than lecture-based training for the acquisition of ECG analysis and interpretation skills (hereafter referred to as ECG competence) . A sub-analysis of this meta-analysis showed that blended learning (face-to-face lectures complemented by e-learning)  had a positive impact on the acquisition of ECG competence. However, the effectiveness of blended learning on the retention of ECG competence remains unknown .
The aim of our study was therefore to compare the effectiveness of blended learning (combination of face-to-face lectures and e-learning) to conventional ECG teaching (face-to-face lectures only) on the acquisition and retention of ECG competence of medical students (Fig. 1).
Study design and participants
This prospective study, conducted from January 2016 to November 2017, included two cohorts of fourth year medical students at the University of Cape Town, South Africa. Medical students were recruited during their Internal Medicine clinical clerkship, during which Electrocardiography is traditionally taught. Students recruited in 2016 formed the conventional teaching cohort, whereas students from 2017 formed the blended learning cohort.
Method of ECG instruction
At the University of Cape Town, medical students are introduced to the basic principles of Electrocardiography during their third year of study, when they attend a series of lectures introducing rhythm and waveform abnormalities. Therefore, all participants in this study had prior exposure to ECG teaching in the preceding academic year. Training in Electrocardiography continues during the fourth-year Internal Medicine clinical clerkship in the form of lectures. Over and above lectures, the clinical clerkship also requires of students to acquire and analyse ECGs on the patients that they see. They present patients and their ECGs to senior clinicians on ward rounds. Although a year apart, both cohorts completed the same Internal Medicine clinical clerkship, with the same clinicians, and the same learning requirements and opportunities, both during lectures and on ward rounds. There is no formal ECG training after the Internal Medicine clinical clerkship. The other fourth-year clerkships at our institution comprise Obstetrics, Neonatology, Psychiatry and Public Health.
During the study period, participants attended two lectures (of 120 min each) at the end of the second and fourth week of the Internal Medicine Clerkship respectively. The lectures revisit the basic principles of ECG analysis (including calculation of the heart rate, measuring the different intervals and calculating the QRS axis), and then predominantly focus on waveform abnormalities (e.g. left and right atrial enlargement, left and right ventricular hypertrophy [LVH, RVH], left and right bundle branch block [LBBB, RBBB], left anterior fascicular block, Wolff-Parkinson-White [WPW] pattern, ST-segment elevation myocardial infarction [STEMI], pericarditis, hyperkalaemia, long QT syndrome) and rhythm abnormalities (e.g. sinus arrhythmia, sinus arrest with escape rhythm, first degree atrioventricular [AV] block, Mobitz I and II second degree AV block, third degree AV block, atrial fibrillation [AF] with normal and uncontrolled rates, atrial flutter, AV node re-entry tachycardia [AVNRT], ventricular tachycardia [VT] and ventricular fibrillation [VF]). The topics included in the syllabus are considered core knowledge for undergraduate ECG training at our Institution . All ECGs were 12-lead ECGs, with the exception of VF for which a chest lead rhythm strip was shown. The lectures were interactive, i.e. students were asked to analyse and interpret all the ECGs shown during the Microsoft® PowerPoint® presentation, and they were encouraged to ask questions. All lectures were facilitated by the same lecturer, who used the same Microsoft® PowerPoint® presentations (demonstrating the same ECG examples and illustrations) throughout the study. Depending on the student allocations to clinical clerkships, the group sizes varied between 32 and 42 students.
Both cohorts received the same lectures. In addition, the blended learning cohort had access to a web application (ECG ONLINE, accessed at ecgonline.uct.ac.za), which facilitated ECG analysis and interpretation with feedback. Access was free, but restricted to University staff and registered students at the time of the study. Use of the web application was voluntary; its use was not a compulsory learning activity during the clerkship. Once signed into the web application, users had access to five online modules, each containing four to six ECGs to analyse. The ECGs used in the web application were different to the ECGs used during the lectures, but were of the same diagnoses discussed in class. For each of the 24 ECGs contained in the web application, the user was provided with a standardised template for online analysis, as shown in Supplementary Material 1. The template contained checkboxes for normal and abnormal parameters, as well as textboxes for interval measurements and axis calculations. For each ECG, the user selected the checkboxes that were relevant to the ECG analysis and entered the values of the interval measurements and axis calculations. The web application required that users analysed the rate and rhythm before proceeding to the detailed waveform analysis, and prior to providing their interpretation (diagnosis) of the ECG . Once the process of ECG analysis and interpretation were complete and submitted, users were provided with the correct answers on the same page to facilitate comparison with the answers they had provided. For each analysed ECG, the user could also download a document with a take-home message (with text and annotated ECGs), as shown in Supplementary Material 2. There was no limit to the number of times that participants could analyse the ECGs. Students could also review their previous analyses, along with the answers of all their previously submitted ECGs. The web application monitored the number of ECGs analysed by each user.
The features offered by the web application used in this study, as well as the ECG curriculum taught online, are summarised in Table 1. These aspects were compared to undergraduate ECG teaching software that has previously been described in the literature [18, 24,25,26,27,28,29,30,31,32,33], and assessed by the modified Kirkpatrick framework .
Assessment of ECG competence
The study flow of participants and competence tests is outlined in Fig. 1. During the study, participants were asked to complete three 30-min competence tests. Each comprised 28 single best answer multiple-choice questions (MCQ). The first MCQ test (pre-intervention test) was written on enrolment, i.e. in the first week of the Internal Medicine clinical clerkship, prior to any ECG teaching in that academic year, to determine baseline (pre-existing) ECG competence. The second MCQ test (immediate post-intervention test) was written at the end of the six-week clinical clerkship, after ECG tuition (with or without access to e-learning in the blended learning and conventional teaching cohorts respectively), to assess the participants’ acquisition of ECG competence. The third MCQ test (delayed post-intervention test) was written 6 months later, without any further ECG training, or access to the web application, to assess the participants’ retention of ECG competence. The first, second and third MCQ tests respectively were the same for both cohorts, i.e. the two cohorts underwent the same assessment of baseline ECG competence, as well as acquisition and retention of ECG competence.
The three tests examined the same topics, using the same multiple-choice questions and answers, but with different exemplar ECGs in the three respective tests. Each test included three questions regarding basic ECG analysis (i.e. calculating the rate, measuring the QRS width and determining the QRS axis), as well as 25 ECG diagnoses. Of these, 12 were rhythm abnormalities (sinus arrhythmia, sinus arrest with escape rhythm, first degree AV block, Mobitz I and II second degree AV block, third degree AV block, AF with normal and uncontrolled rates, atrial flutter, AVNRT, VT and VF), and 13 were waveform abnormalities (left and right atrial enlargement, LVH, RVH, LBBB, RBBB, left anterior fascicular block, WPW pattern, anterior and inferior STEMI, pericarditis, hyperkalaemia, long QT syndrome). These conditions that were included in the MCQ tests are considered core knowledge for the undergraduate ECG training at our Institution . The ECGs used in the tests were not the same as those used in class or on the web application. Two cardiologists and two specialist physicians, with a special interest in Electrocardiography, agreed that the ECGs used in the tests were unequivocal examples of the conditions and that the multiple-choice options were fair for the given ECG.
The MCQ tests were administered electronically at the University computer laboratories. They were invigilated, password-protected and could only be accessed on the day of the test. The order in which the questions were asked was randomised. For each question, there were five optional answers - four possible diagnoses (of which only one was correct), and a fifth option, i.e. “I am not sure what the answer is”. Each correct question was awarded one mark and negative marking was not applied. The answers to the questions were only made available to the students at the end of the study. The results of the MCQ tests in this study did not contribute to the participants’ course mark.
Survey of confidence in ECG interpretation
After the immediate post-intervention test, participants completed a survey in which they were asked to rate their confidence in ECG analysis and interpretation using 5-point Likert-type questions (to which the participants could select strongly agree, agree, neutral, disagree or strongly disagree) [35, 36]. For purposes of analysis, the responses were clustered into three categories (agree, neutral and disagree).
Determining other learning materials used during study period
After the immediate post-intervention test, participants were also asked to declare which learning materials (i.e. textbooks, class notes) they used during the study period.
Students’ perception of lectures and web-based learning
Participants were asked to comment on what they liked and what they disliked of the lectures (both the conventional teaching and blended learning cohorts) and web application (blended learning cohort only). The feedback was received in free-text form. Two investigators (CAV, VCB) performed qualitative content analysis of the feedback from the participants. An inductive approach was used to identify themes and subthemes from the free-text comments made by the participants with regards to the lectures and web application [37, 38]. The themes and subthemes were refined through an iterative process of reviewing the participants’ responses . Disagreement was resolved through discussions with a third investigator (RSM). A deductive approach was used to quantify the frequency in which the themes and subthemes emerged from the feedback on the lectures and web application .
Estimated sample size needed for an adequately powered study
We estimated that a minimum sample size of 36 participants in each group would provide 80% power to detect a mean difference of 10% in the test scores after intervention between the two groups and considering an α (type 1 error) of 5%. This calculation was based on the results of previous studies that compared blended learning (lectures complemented by CAI) to lectures alone for teaching Electrocardiography [18, 25, 29, 31].
Eligibility to be included in the study
All fourth-year medical students were invited to take part in the study; participation was voluntary. Participants were only included if they completed all three MCQ tests and the survey on ECG confidence during the study period.
Statistical analyses were performed on anonymised data using Stata (Version 14.2, StataCorp, College Station TX, USA). The Shapiro-Wilk test was used to assess distributional normality of data . Parametric data were summarised as means with standard deviations (SD), whereas median with interquartile range (IQR) were used for non-parametric data. Paired and unpaired t-tests were used to assess within-group and between-group differences in test scores respectively. Cohen’s d was used to determine the effect size (practical significance) of the differences in test scores, with values of 0.2, 0.5 and 0.8 indicating small, moderate and large effect sizes respectively. Categorical variables were expressed as frequencies and percentages. Chi-squared or Fisher’s exact tests were used, where applicable, to compare categorical variables. A p value of < 0.05 was considered statistically significant.
All fourth-year medical students were invited to participate in the study. The conventional teaching cohort consisted of 67 of the 86 students from the 2016 class, whereas the blended learning cohort comprised 64 of 98 students from the 2017 class.
Use of ECG learning material during the study period
All students in the blended learning cohort accessed the web application. Of the 24 ECGs on the web application, the median number of ECGs that were analysed and interpreted was 24 (IQR 21–24). After having analysed all the ECGs they had access to, almost two-thirds (64.2%) of the participants analysed at least one of the 24 ECGs more than once. As depicted in Fig. 2, the web application was used throughout the day, but the peak times were around midday and early evening. Those who had access to the online modules used textbooks less often than the group who attended lectures only (31.3% vs 56.1%, p = 0.003). However, both groups made similar use of their class notes to study ECGs (68.6% vs 71.6%, p = 0.717).
Baseline ECG competence
As shown in Table 2, the cohorts exposed to blended learning or conventional teaching started with similar baseline ECG competence (mean pre-intervention test scores of 31.0% ± 13.2% and 31.2 ± 11.5% respectively, p = 0.917).
Acquisition of ECG competence
Both cohorts showed a significant improvement in ECG competence after 6 weeks of training (Fig. 3). The conventional teaching cohort demonstrated a 1.6-fold increase in the mean test scores (31.2 ± 11.5% [pre-intervention test] to 50.3 ± 17.1%, p < 0.001 [immediate post-intervention test]; Cohen’s d = 1.3 [95% CI 0.9, 1.6]), whereas a 2.4-fold improvement in mean test scores was observed in the cohort exposed to the blended learning strategy (31.0% ± 13.2% to 75.3 ± 16.2%, p < 0.001; Cohen’s d = 3.1 [95% CI 2.6, 3.6]). The difference in acquisition of competence test scores between the two cohorts was also highly significant (Cohen’s d = 1.5 [95% CI 1.1, 1.9]). These test performance improvements were observed for basic analysis, as well as for the interpretation of rhythm and waveform abnormalities in the immediate post-intervention test (Table 2).
Retention of ECG competence
After 6 months of no further ECG training, both cohorts demonstrated attrition of ECG competence (Table 2, Fig. 3). ECG competence declined significantly between the immediate and delayed post-intervention tests in the conventional teaching cohort (50.3 ± 17.1% to 37.6 ± 16.4%, p < 0.001, Cohen’s d = − 0.8 [95% CI -1.1, − 0.4]). Of note is that the delayed post-intervention test score in the conventional teaching cohort was similar to that of their pre-intervention test score (31.2 ± 11.5% vs 37.6 ± 16.4%, p < 0.001, Cohen’s d = 0.4 [95% CI 0.1, 0.8]). The attrition of ECG competence between the immediate and delayed post-intervention tests was also significant in the blended learning cohort (mean score of 75.3 ± 16.2% to 57.7 ± 18.5%, p < 0.001, Cohen’s d = − 1.0 [95% CI -1.4, − 0.6]). However, in this cohort of students, ECG competence at 6 months remained almost twice as much as their initial performance in the baseline test (57.7 ± 18.5% vs 31.0% ± 13.2%, p < 0.001, Cohen’s d = 1.7 [95% CI 1.3, 2.1]). Indeed, the blended learning cohort’s performance in the delayed post-intervention test was better than that achieved by the students who received conventional teaching immediately post-intervention (mean score of 57.7 ± 18.5% vs 50.3 ± 17.1%). Again, significant differences in test scores were observed for basic analysis, as well as for the interpretation of rhythm and waveform abnormalities between the two cohorts in the delayed post-intervention test.
Decreased diagnostic uncertainty after training
As shown in Table 3, during the pre-intervention test, the “I am not sure what the answer is” option (indicating diagnostic uncertainty) was selected by the blended learning cohort as the response for 27.5% of the questions. In the same test, participants who attended conventional lectures indicated diagnostic uncertainty for 22.1% of the submitted answers. For both cohorts, there was a significant reduction in the diagnostic uncertainty in the immediate and delayed post-intervention tests. Post-intervention analysis of the responses, for which there was initial diagnostic uncertainty, translated to a significantly higher proportion of correct responses in the blended learning cohort versus the cohort that only attended lectures. This effect was still observed after 6 months.
Students’ confidence and competence at ECG analysis and interpretation
A comparison of participants’ perceptions of their confidence and their measured competence in ECG analysis and interpretation, is shown in Table 4. Students exposed to blended learning reported less difficulty in ECG analysis and interpretation and performed significantly better in the immediate post-intervention test. Sub-group analyses showed that students who undertook blended learning demonstrated high levels of confidence and competence in rhythm and waveform analysis. While students who attended conventional teaching reported high levels of confidence in rhythm analysis, this was not associated with high levels of diagnostic accuracy of arrhythmias. These students did, however, lack confidence in waveform analysis, which was mirrored by significantly poorer performance compared to students exposed to blended learning.
Students’ perception of ECG lectures
As summarised in Table 5, students from both the conventional teaching and blended learning cohorts found the lectures to be interactive and contextualised. Overall, students complimented the systematic, stepwise approach to ECG analysis and interpretation that was taught during the lectures. They liked that difficult concepts were simplified and that they were taught to understand mechanisms causing waveform and rhythm abnormalities, instead of merely memorising patterns. Whereas some students felt that there was insight to their level of understanding, others reported that the lecturer did not gauge whether they understood concepts in class or not. Although both cohorts liked the practice of ECG analysis under supervision of a lecturer, the conventional cohort in particular pointed out that there was not enough opportunity to practice in class. Those from the blended learning cohort reported that the combination of lectures and the web application was beneficial for their learning, because they could apply their knowledge. However, the students often appeared overwhelmed by the lectures, saying that there was “too much information covered in one go”. They did not appreciate late afternoon lectures or attending ECG lectures only midway into the clinical clerkship. The blended learning cohort, in particular, criticised the lectures as being too long and covering too much content. However, the cohort who only attended lectures commented more often that the lectures were too few and too sporadic. The cohort that received conventional teaching reported that the lectures consisted of too many students, there was a lack of opportunity to practise ECG analysis in class and students were afraid to participate in front of their peers (Table 6).
Students’ perception of online ECG learning
Tables 7 and 8 respectively depict what the blended learning cohort liked and disliked about the web application. These students commented favourably on the fact that the web application allowed for practice and revision of ECG analysis and interpretation, and that it facilitated asynchronous learning (i.e. whenever or wherever convenient, at their own pace). The most important features that were positively perceived were the systematic approach that was taught online, the take-home messages that could be downloaded for every ECG that they analysed and the immediate feedback received after they analysed and interpreted the ECG. However, the web application was criticised because, although it displayed whether the analysis was correct or incorrect and provided the correct answer, it did not indicate or explain why an answer was incorrect in the case of an incorrect submission. Although some students felt that the web application exposed them to a wide variety of ECGs, others reported that they would have liked more examples of each condition. Technical aspects such as web page layout and the intermittent ‘bugs and glitches’ were also criticised.
This study evaluated the effectiveness of using a blended learning strategy (i.e. conventional lectures supplemented with the use of a web application) and compared results to conventional teaching (i.e. lectures alone) of ECG analysis and interpretation skills in fourth year medical students. We found that blended learning was associated with greater confidence and competence in ECG analysis and interpretation skills, immediately after the educational intervention. These gains were evident in basic ECG analysis (i.e. calculating the heart rate, QRS width and axis), as well as in the interpretation of rhythm and waveform abnormalities. Whilst there was attrition of ECG competence in both groups after 6 months of no further ECG teaching, those exposed to blended learning retained significantly more ECG analysis and interpretation skills than their counterparts who only attended lectures. Although diagnostic uncertainty decreased with both blended learning and conventional ECG teaching, those who engaged in blended learning activities had significantly better diagnostic accuracy in the immediate and delayed post-intervention tests for topics for which they initially reported diagnostic uncertainty.
There are various possible reasons for the superior gains in ECG competence with a blended learning strategy. First and foremost, blended learning potentially increases the time that students spend on ECG learning. Many have argued that current undergraduate medical training does not allow sufficient time for this activity [7, 8, 42, 43]. In our study, students reported that they found lectures to be too short and sporadic. This was especially true for those from the conventional teaching cohort. In this regard, a blended learning strategy offers the benefit of additional training by means of a web application, without increasing face-to-face ECG tuition time [15, 28]. The benefit of supplementing lectures with e-learning had been shown to be most significant when students had unrestricted access to computer-assisted ECG instruction .
As shown in this study, an important benefit of e-learning is that it allows for asynchronous learning, because students can study the online material wherever and whenever convenient, in addition to attending face-to-face teaching [9, 28, 44, 45]. We also showed that ECG learning on the web application took place throughout the day, but peaked at midday and early evening, at which time students do not have lectures. Asynchronous e-learning supports the self-directed learning theory in which learners self-regulate their learning by planning and monitoring their learning [46,47,48,49]. Self-directed learning allows for repetitive practice and focused revision of learning material [19, 50,51,52], which has been shown to be of benefit. This was true in our study, as participants commented that both lectures and web application taught a systematic approach to ECG analysis and interpretation, but that the online platform allowed them the opportunity to practise and consolidate these diagnostic approaches through repetition. With self-directed and asynchronous e-learning, students can adjust the pace of their learning and spend as much time as they need to assimilate new knowledge [24, 25, 53], which is a major advantage of blended learning over conventional classroom ECG teaching. This was consistent with the feedback from the participants in this study, as the lectures were criticised for being too rushed and covering too much content in too little time, whereas with the web application they could study at their own pace.
In our study, students who undertook blended learning had the opportunity to practise ECG analysis online and receive immediate feedback. As one participant pointed out “The best part was having such immediate feedback … I learnt from my mistakes straight away without wondering where I went wrong or forgetting to follow up with a lecturer”. These self-administered online quizzes filled the gap of limited opportunity for practice and feedback during lectures, especially in the large group setting [42, 54]. Indeed, those who only attended lectures pointed out the lack of opportunity to practise ECG analysis in class more often. This is an important drawback of large group teaching . Deliberate practice with feedback, which underpins reflective models of learning, has previously been shown to enhance learning [52, 56, 57], and improve the retention of knowledge [58, 59]. This is also true of the initial acquisition of ECG competence [18, 25, 28, 29, 60]. The findings of our study further support these observations in the literature. In addition, we show that blended learning using a web application providing immediate feedback was also associated with better retention of ECG competence 6 months after the learning activities. This has not previously been reported .
Our study confirms the ‘learning and forgetting curve’ described in the literature, where competence increases with training, but declines without ongoing teaching  and testing . In this study, all students experienced attrition of ECG competence in the absence of ongoing ECG training. The attrition rate was the same over time amongst those who engaged in blended learning and those who attended lectures during their clerkship. After 6 months of no further ECG training, both cohorts retained 75% of the ECG competence gained by the respective educational interventions. However, the retention of ECG analysis and interpretation skills was significantly better in the blended learning group. This could potentially be explained by the higher level of ECG competency initially achieved by this group during the clinical clerkship.
In other domains of medicine, such as dermatology and radiology, where diagnosis also depends on a visual analysis, it has been shown that diagnostic uncertainty decreases with experience [63,64,65,66]. Our work confirms that this is true for Electrocardiography as well, whether conventional or blended learning strategies are used. However, students who engaged in blended ECG learning activities achieved better diagnostic accuracy for topics for which there was initial diagnostic uncertainty.
In addition to the lack of ECG competence, undergraduate and postgraduate students also lack confidence in ECG analysis and interpretation, which improves with training . In this study we observed that medical students exposed to blended learning were more confident in ECG analysis and interpretation at the end of their clinical clerkship. This confidence matched their competence in basic ECG analysis and the interpretation of abnormal rhythms and waveforms. However, for students who were exposed to conventional ECG teaching alone, there was a dissociation between their self-reported confidence and competence in rhythm analysis.
The development of web-based learning material has the potential of being expensive and time-consuming for both lecturer and student. Although the creation of educational content requires the experience of the medical educator, the creation and maintenance of online platforms on which the educational content is ultimately hosted requires information technology (IT) skill and expertise, which might not necessarily be available at all teaching institutions [45, 67]. The implication is therefore that funding should be sought for the development and hosting of online material, which may be an additional burden to Faculty budgets. Although ECG ONLINE was offered to our students at no cost, the expense of development and hosting of the web application to date is estimated at $30,000. To make online learning financially sustainable, students are often required to pay subscriptions to access web applications. The creation of new material also requires the time of lecturers, who are often clinicians with busy practices. However, once created and accessible to students, it could offer unlimited contact time with online material. The deliberate practice with feedback on web applications is not limited to the time and availability of the lecturer. Lecturers should, however, recognise the danger of curricular overload [22, 68], and consider whether their students’ studying schedules would allow for additional learning material.
Our research has practice implications. On the basis of our study, we have implemented blended learning using a web application that facilitates deliberate practice of ECG analysis and interpretation with feedback. Whether this strategy will benefit graduating medical students and ultimately improve patient care remains to be studied. However, an additional challenge for educators will be to further improve retention of ECG competence through continuous exposure in a longitudinal curriculum .
In a study with different cohorts, there is a possibility of performance bias, i.e. exposure to factors other than the educational intervention that may have influenced the outcomes among the different groups. Although the two cohorts reviewed ECGs with the same senior clinicians on ward rounds, it is impossible to control teaching opportunities during a clinical clerkship.
We acknowledge different participation rates in the two cohorts. This is most likely due to a change in the order of the fourth-year clinical clerkships at the University during the study period. Participants in the blended learning cohort had to travel from another hospital to take part in the retention of knowledge tests, whereas the conventional teaching cohort was already on the same campus as the computer laboratories on the day of the retention test. However, the number of eligible participants and the results of the pre-intervention tests did not differ between the cohorts.
It was beyond the scope of this study to evaluate how the students engaged with the online material. Such an appraisal would be important to improve future e-learning interventions and blended learning strategies, and should be studied in future.
Our study found that a blended learning strategy resulted in better acquisition of ECG competence than lectures alone. As expected, diagnostic uncertainty decreased with both teaching modalities. However, blended learning was associated with better diagnostic accuracy in situations where there was initial diagnostic uncertainty. Whilst there was an attrition of ECG analysis and interpretation skills without further training, the six-month retention of ECG competence was better amongst those who were exposed to blended learning. Blended learning using a web application that facilitates deliberate practice of systematic ECG analysis with feedback may, therefore, be a useful addition to the learning toolbox for Electrocardiography training of medical students.
‘Blended learning’ refers to a combination of lectures and e-learning .
‘Computer-assisted instruction’ (CAI) refers to any teaching method that uses a digital platform as a self-directed learning technique .
‘E-learning’ refers to the teaching method whereby electronic technologies (such as web applications) are used to access learning material .
‘ECG analysis’ refers to the detailed examination of an ECG tracing, which requires the measurement of intervals and the evaluation of the rhythm and each waveform .
‘ECG interpretation’ refers to the conclusion reached after careful ECG analysis, that is, making a diagnosis of an arrhythmia, ischaemia and so on .
‘ECG competence’ refers to the ability to accurately analyse and interpret the ECG .
‘ECG knowledge’ refers to the understanding of ECG concepts, for example, knowing that transmural ischaemia or pericarditis can cause ST-segment elevation .
Availability of data and materials
The datasets used and/or analysed during the current study, are available in the “Effectiveness of blended learning versus lectures alone on ECG analysis and interpretation by medical students” repository, which could be accessed at https://doi.org/10.25375/uct.12931262.v1.
Atrioventricular nodal re-entry tachycardia
Information and communication technology services
Left bundle branch block
Left ventricular hypertrophy
Right bundle branch block
Right ventricular hypertrophy
ST-segment elevation myocardial infarction
University of Cape Town
Wolff Parkinson White
Bogun F, Anh D, Kalahasty G, Wissner E, Bou Serhal C, Bazzi R, et al. Misdiagnosis of atrial fibrillation and its clinical consequences. Am J Med. 2004;117(9):636–42.
Masoudi FA, Magid DJ, Vinson DR, Tricomi AJ, Lyons EE, Crounse L, et al. Implications of the failure to identify high-risk electrocardiogram findings for the quality of care of patients with acute myocardial infarction: results of the emergency department quality in myocardial infarction (EDQMI) study. Circulation. 2006;114(15):1565–71.
Schlapfer J, Wellens HJ. Computer-interpreted electrocardiograms: benefits and limitations. J Am Coll Cardiol. 2017;70(9):1183–92.
Mant J, Fitzmaurice DA, Hobbs FD, Jowett S, Murray ET, Holder R, et al. Accuracy of diagnosing atrial fibrillation on electrocardiogram by primary care practitioners and interpretative diagnostic software: analysis of data from screening for atrial fibrillation in the elderly (SAFE) trial. BMJ. 2007;335(7616):380.
Guglin ME, Thatai D. Common errors in computer electrocardiogram interpretation. Int J Cardiol. 2006;106(2):232–7.
Hurst JW. The interpretation of electrocardiograms: pretense or a well-developed skill? Cardiol Clin. 2006;24(3):305–7 vii.
Jablonover RS, Lundberg E, Zhang Y, Stagnaro-Green A. Competency in electrocardiogram interpretation among graduating medical students. Teach Learn Med. 2014;26(3):279–84.
Breen C, Zhu T, Bond R, Finlay D, Clifford G. The evaluation of an open source online training system for teaching 12 lead electrocardiographic interpretation. J Electrocardiol. 2016;49(3):454–61.
Rolskov Bojsen S, Rader SB, Holst AG, Kayser L, Ringsted C, Hastrup Svendsen J, et al. The acquisition and retention of ECG interpretation skills after a standardized web-based ECG tutorial-a randomised study. BMC Med Educ. 2015;15:36.
Blissett S, Cavalcanti R, Sibbald M. ECG rhythm analysis with expert and learner-generated schemas in novice learners. Adv Health Sci Educ Theory Pract. 2015;20(4):915–33.
Kopec G, Magon W, Holda M, Podolec P. Competency in ECG interpretation among medical students. Med Sci Monitor. 2015;21.
Lever NA, Larsen PD, Dawes M, Wong A, Harding SA. Are our medical graduates in New Zealand safe and accurate in ECG interpretation? N Z Med J. 2009;122(1292):9–15.
Little B, Mainie I, Ho KJ, Scott L. Electrocardiogram and rhythm strip interpretation by final year medical students. Ulster Med J. 2001;70(2):108–10.
McAloon C, Leach H, Gill S, Aluwalia A, Trevelyan J. Improving ECG competence in medical trainees in a UK district general hospital. Cardiol Res. 2014;5(2):51–7.
Choules AP. The use of elearning in medical education: a review of the current situation. Postgrad Med J. 2007;83(978):212–6.
Vallée A, Blacher J, Cariou A, Sorbets E. Blended learning compared to traditional learning in medical education: systematic review and meta-analysis. J Med Internet Res. 2020;22(8):e16504.
Owen S, Hall R, Waller I. Use of a teaching machine in medical education; preliminary experience with a programme in electrocardiography. Postgrad Med J. 1964;40(460):59.
Viljoen CA, Scott Millar R, Engel ME, Shelton M, Burch V. Is computer-assisted instruction more effective than other educational methods in achieving ECG competence amongst medical students and residents? A systematic review and meta-analysis. BMJ Open. 2019;9(11):e028800.
Hatala R, Gutman J, Lineberry M, Triola M, Pusic M. How well is each learner learning? Validity investigation of a learning curve-based assessment approach for ECG interpretation. Adv Health Sci Educ Theory Pract. 2019;24(1):45–63.
Cook DA, Levinson AJ, Garside S, Dupras DM, Erwin PJ, Montori VM. Internet-based learning in the health professions: a meta-analysis. Jama. 2008;300(10):1181–96.
Morton CE, Saleh SN, Smith SF, Hemani A, Ameen A, Bennie TD, et al. Blended learning: how can we optimise undergraduate student engagement? BMC Med Educ. 2016;16:195.
Viljoen CA, Millar RS, Manning K, Burch VC. Determining electrocardiography training priorities for medical students using a modified Delphi method. BMC Med Educ. 2020;20(1):431.
Viljoen CA, Scott Millar R, Engel ME, Shelton M, Burch V. Is computer-assisted instruction more effective than other educational methods in achieving ECG competence among medical students and residents? Protocol for a systematic review and meta-analysis. BMJ Open. 2017;7(12):e018811.
Akbarzadeh F, Arbat BK, Alizadeh A, Akbarzadeh AH. The efficacy of web-based multimedia education of normal electrocardiogram in junior and senior medical students. Res Dev Med Educ. 2012;1(2):77–9.
Chudgar SM, Engle DL, Grochowski CO, Gagliardi JP. Teaching crucial skills: an electrocardiogram teaching module for medical students. J Electrocardiol. 2016;49(4):490–5.
Davies A, Macleod R, Bennett-Britton I, McElnay P, Bakhbakhi D, Sansom J. E-learning and near-peer teaching in electrocardiogram education: a randomised trial. Clin Teach. 2016;13(3):227–30.
Fent G, Gosai J, Purva M. A randomized control trial comparing use of a novel electrocardiogram simulator with traditional teaching in the acquisition of electrocardiogram interpretation skill. J Electrocardiol. 2016;49(2):112–6.
Montassier E, Hardouin JB, Segard J, Batard E, Potel G, Planchon B, et al. E-learning versus lecture-based courses in ECG interpretation for undergraduate medical students: a randomized noninferiority study. Eur J Emerg Med. 2016;23(2):108–13.
Nilsson M, Bolinder G, Held C, Johansson BL, Fors U, Ostergren J. Evaluation of a web-based ECG-interpretation programme for undergraduate medical students. BMC Med Educ. 2008;8:25.
Patuwo T, Wagner G, Ajijola O, editors. Comparison of teaching basic electrocardiographic concepts with and without ECGSIM, an interactive program for electrocardiography. Comput Cardiol. 2007;34:61−4.
Rui Z, Lian-Rui X, Rong-Zheng Y, Jing Z, Xue-Hong W, Chuan Z. Friend or foe? Flipped classroom for undergraduate electrocardiogram learning: a randomized controlled study. BMC Med Educ. 2017;17(1):53.
Sonali N, Limaye RP, Madhushree K, Gokhale DV, Neeta G, Patil TR. Assessing impact of computer assisted learning (cal) on cognitive perception -a study in medical college students. Res J Pharm Biol Chem Sci. 2014;5(4):600–4.
Pontes PAI, Chaves RO, Castro RC, de Souza EF, Seruffo MCR, Frances CRL. Educational software applied in teaching electrocardiogram: a systematic review. Biomed Res Int. 2018;2018:8203875.
Yardley S, Dornan T. Kirkpatrick's levels and education 'evidence. Med Educ. 2012;46(1):97–106.
Boone HN, Boone DA. Analyzing likert data. J Ext. 2012;50(2):1-5.
Norman G. Likert scales, levels of measurement and the "laws" of statistics. Adv Health Sci Educ Theory Pract. 2010;15(5):625–32.
Hashemnezhad H. Qualitative content analysis research: A review article. J ELT Appl Linguist. 2015;3(1).
Tavakol M, Sandars J. Quantitative and qualitative methods in medical education research: AMEE guide no 90: part I. Med Teach. 2014;36(9):746–56.
Tavakol M, Sandars J. Quantitative and qualitative methods in medical education research: AMEE guide no 90: part II. Med Teach. 2014;36(10):838–48.
Walling A, Istas K, Bonaminio GA, Paolo AM, Fontes JD, Davis N, et al. Medical student perspectives of active learning: a focus group study. Teach Learn Med. 2017;29(2):173–80.
Shapiro SS, Wilk MB. An analysis of variance test for normality (complete samples). Biometrika. 1965;52(3/4):591–611.
Fent G, Gosai J, Purva M. Teaching the interpretation of electrocardiograms: which method is best? J Electrocardiol. 2015;48(2):190–3.
Hurst JW. Current status of clinical electrocardiography with suggestions for the improvement of the interpretive process. Am J Cardiol. 2003;92(9):1072–9.
Greenhalgh T. Computer assisted learning in undergraduate medical education. BMJ. 2001;322(7277):40–4.
Cook DA. Web-based learning: pros, cons and controversies. Clin Med. 2007;7(1):37–42.
Young JQ, Van Merrienboer J, Durning S, Ten Cate O. Cognitive load theory: implications for medical education: AMEE guide no. 86. Med Teach. 2014;36(5):371–84.
Neufeld VR, Barrows HS. The" McMaster philosophy": an approach to medical education. Acad Med. 1974;49(11):1040–50.
Murray CJ, Barber RM, Foreman KJ, Abbasoglu Ozgoren A, Abd-Allah F, Abera SF, et al. Global, regional, and national disability-adjusted life years (DALYs) for 306 diseases and injuries and healthy life expectancy (HALE) for 188 countries, 1990-2013: quantifying the epidemiological transition. Lancet. 2015;386(10009):2145–91.
Taylor DC, Hamdy H. Adult learning theories: implications for learning and teaching in medical education: AMEE guide no. 83. Med Teach. 2013;35(11):e1561–e72.
Khogali S, Davies DA, Donnan P, Gray A, Harden RM, McDonald J, et al. Integration of e-learning resources into a medical school curriculum. Med Teach. 2011;33(4):311–8.
Custers EJFM. Long-term retention of basic science knowledge: a review study. Adv Health Sci Educ Theory Pract. 2010;15(1):109–28.
Issenberg SB, McGaghie WC, Petrusa ER, Lee Gordon D, Scalese RJ. Features and uses of high-fidelity medical simulations that lead to effective learning: a BEME systematic review. Med Teach. 2005;27(1):10–28.
Owen SG, Hall R, Anderson J, Smart GA. Programmed learning in medical education. An experimental comparison of programmed instruction by teaching machine with conventional lecturing in the teaching of electrocardiography to final year medical students. Postgrad Med J. 1965;41(474):201–5.
Cantillon P. Teaching large groups. BMJ. 2003;326(7386):437.
Luscombe C, Montgomery J. Exploring medical student learning in the large group teaching environment: examining current practice to inform curricular development. BMC Med Educ. 2016;16:184.
Cook DA, Levinson AJ, Garside S, Dupras DM, Erwin PJ, Montori VM. Instructional design variations in internet-based learning for health professions education: a systematic review and meta-analysis. Acad Med. 2010;85(5):909–22.
Ericsson KA, Krampe RT, Tesch-Römer C. The role of deliberate practice in the acquisition of expert performance. Psychol Rev. 1993;100(3):363.
Larsen DP, Butler AC, Roediger HL 3rd. Test-enhanced learning in medical education. Med Educ. 2008;42(10):959–66.
Ericsson KA. Deliberate practice and the acquisition and maintenance of expert performance in medicine and related domains. Acad Med. 2004;79(10):S70–81.
Barthelemy FX, Segard J, Fradin P, Hourdin N, Batard E, Pottier P, et al. ECG interpretation in emergency department residents: an update and e-learning as a resource to improve skills. Eur J Emerg Med. 2017;24(2):149–56.
Pusic MV, Kessler D, Szyld D, Kalet A, Pecaric M, Boutis K. Experience curves as an organizing framework for deliberate practice in emergency medicine learning. Acad Emerg Med. 2012;19(12):1476–80.
Boutis K, Pecaric M, Carriere B, Stimec J, Willan A, Chan J, et al. The effect of testing and feedback on the forgetting curves for radiograph interpretation skills. Med Teach. 2019;41(7):756–64.
Lawton R, Robinson O, Harrison R, Mason S, Conner M, Wilson B. Are more experienced clinicians better able to tolerate uncertainty and manage risks? A vignette study of doctors in three NHS emergency departments in England. BMJ Qual Saf. 2019;28(5):382–8.
Zwaan L, Hautz WE. Bridging the gap between uncertainty, confidence and diagnostic accuracy: calibration is key. BMJ Qual Saf. 2019;28(5):352–5.
Lowenstein EJ, Sidlow R. Cognitive and visual diagnostic errors in dermatology: part 1. Br J Dermatol. 2018;179(6):1263–9.
Kok EM, Jarodzka H, de Bruin AB, BinAmir HA, Robben SG, van Merrienboer JJ. Systematic viewing in radiology: seeing more, missing less? Adv Health Sci Educ Theory Pract. 2016;21(1):189–205.
Masters K, Ellaway R. E-learning in medical education guide 32 part 2: technology, management and design. Med Teach. 2008;30(5):474–89.
van den Berge K, van Gog T, Mamede S, Schmidt HG, van Saase JLCM, Rikers RMJP. Acquisition of visual perceptual skills from worked examples: learning to interpret electrocardiograms (ECGs). Interact Learn Environ. 2013;21(3):263–72.
Ellaway R, Masters K. AMEE guide 32: e-learning in medical education part 1: learning, teaching and assessment. Med Teach. 2008;30(5):455–73.
The authors wish to thank Dr. Rachel Weiss, Professor Mpiko Ntsekhe and Professor Ashley Chin for their important role in the development of ECG ONLINE. We wish to thank Jason Sheldon for creating and maintaining ECG ONLINE during the study period, and the ICTS at the University of Cape Town for hosting the web application. We are grateful for the advice and guidance from Francois Oosthuizen and the generous support of the Research Contracts and Innovations Office and the University of Cape Town, who through various research and teaching grants, have made the development and improvement of ECG ONLINE possible. We would like to thank Mr. Charle Viljoen for analytical support and Dr. Julian Hövelmann, Dr. Nicholas Simpson and Ms. Sylvia Dennis for their excellent help in the manuscript preparation. We are grateful to the academic staff, Professor Nicci Wearne, Dr. Ayanada Gcelu, Ms. Sipho Mankayi, Ms. Zanele Magwa and Ms. Janine Daniels, for their assistance with the lectures and invigilating at the ECG assessments. Finally, we would like to thank our students for their dedication in taking part in the study and their very valuable feedback to help improve undergraduate ECG training.
ECG ONLINE (ecgonline.uct.ac.za) was developed by the Clinical Skills Centre in collaboration with the Division of Cardiology and Department of Medicine at the University of Cape Town. Development of ECG ONLINE was funded by a Teaching Development Grant and the Clinical Skills Centre at the University of Cape Town. Access to the web application was free.
Ethics approval and consent to participate
Approval was obtained from the Human Research Ethics Committee (HREC) at the Faculty of Health Sciences (HREC reference number 764/2015), as well as institutional permission from the Department of Student Affairs at the University of Cape Town. All participants signed informed consent prior to enrolment into the study.
Consent for publication
Study participants provided written informed consent for the anonymised analysis of their ECG competence tests and a possible scientific publication of the results.
The authors report no conflicts of interest. None of the authors received remuneration from ECG ONLINE. The authors alone are responsible for the content and writing of the article.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
. The user was provided with a short clinical vignette and ECG with a standardised template for online analysis.
. Example of a ‘take-home message’ that could be downloaded from the web application once the ECG was analysed and interpreted.
About this article
Cite this article
Viljoen, C.A., Millar, R.S., Manning, K. et al. Effectiveness of blended learning versus lectures alone on ECG analysis and interpretation by medical students. BMC Med Educ 20, 488 (2020). https://doi.org/10.1186/s12909-020-02403-y
- Blended learning
- Medical students