We’re sorry, something doesn't seem to be working properly.
Please try refreshing the page. If that doesn't work, please contact support so we can address the problem.
A combination of traditional learning and e-learning can be more effective on radiological interpretation skills in medical students: a pre- and post-intervention study
BMC Medical Educationvolume 16, Article number: 46 (2016)
The ability to interpret an X-Ray is a vital skill for graduating medical students which guides clinicians towards accurate diagnosis and treatment of the patient. However, research has suggested that radiological interpretation skills are less than satisfactory in not only medical students, but also in residents and consultants.
This study investigated the effectiveness of e-learning for the development of X-ray interpretation skills in pre-clinical medical students. Competencies in clinical X-Ray interpretation were assessed by comparison of pre- and post-intervention scores and one year follow up assessment, where the e-learning course was the ‘intervention’.
Our results demonstrate improved knowledge and skills in X-ray interpretation in students. Assessment of the post training students showed significantly higher scores than the scores of control group of students undertaking the same assessment at the same time.
The development of the Internet and advances in multimedia technologies has paved the way for computer-assisted education. As more rural clinical schools are established the electronic delivery of radiology teaching through websites will become a necessity. The use of e-learning to deliver radiology tuition to medical students represents an exciting alternative and is an effective method of developing competency in radiological interpretation for medical students.
The ability to interpret an X-Ray is a vital skill for medical students, as this imaging modality guides the medical professional towards accurate diagnosis and treatment of a variety of conditions. However, radiological interpretation skills may be less than satisfactory in not only medical students, but also in registrars and consultants [1–9]. With the advancement of imaging technology, medicine is increasingly relying on the unsurpassed anatomical and pathological information provided by radiology, and medical students must be able to extract pertinent clinical information from radiological images.
Formal teaching time in medical school devoted to the interpretation of radiological images is lacking. The duration of specific, pre-clinical radiology teaching in Australian medical schools averages 4 h a year . These statistics are disappointing, as imaging can be utilised as a dynamic teaching utility, demonstrating anatomy, pathology and physiology . Radiology is typically introduced to medical students in their clinical years , when they are confronted with radiological images alongside technical questions from senior doctors. This format may be inadequate to ensure optimal radiology learning, and it may be more beneficial for both students and clinicians that medical students are introduced to radiology as a subject earlier in their training. However, due to the 4-year postgraduate medical degree prevailing in Australian medical schools, it may be unfeasible to introduce additional didactic teaching for radiology to an already condensed program.
The use of e-learning to deliver radiology tuition represents an exciting alternative. E-learning allows students to perfect their skills in a stress-free, non-judgemental environment . E-learning increases the possibilities for more dynamic interactivity and feedback between teacher and student , whilst making education generally more accessible and allowing the learner to work through the content at their own pace . Radiology lends itself particularly well to implementation on a computer-based format due to the highly visual nature of the content .
One of the current issues with radiology-focused educational materials that are available on-line is that they are generally not standardised nor specifically designed to test determined competencies. Medical students have recognised these flaws in current, freely available online radiology modules . However, when e-learning has been specifically designed for medical students and constructed in an interactive manner, this learning modality has been effective in developing competency in radiological interpretation for medical students . Due to the great promise for e-learning teaching modalities to revolutionise education in the future , the primary aim of this study was to further investigate the effectiveness of e-learning for the development of x-ray interpretation skills in pre-clinical medical students.
Students were first and second year students from the Griffith University Bachelor of Medicine/Bachelor of Surgery Program, a 4-year graduate entry program with admission via GAMSAT, grade-point average and interview hurdles. First year students who participated in the study (57/152; 37 % response) were allocated to the ‘intervention group’ receiving the e-learning course; whilst current second year students who participated (66/148; 44 % response) were the ‘control group’ who did not receive e-learning. Both intervention group and control group participated in our traditional formal radiological education activity that included an introductory lecture about how to interpret a chest X-ray followed by a small-group practical workshop where they practiced and developed their skills by studying different chest X-rays. Participants all gave informed consent prior to the experiment via an online form, which was approved by the Griffith University ethics committee for its conduct and publication (MED/23/12/HREC).
The e-learning package (intervention) was developed to enhance students’ competencies in clinical X-ray interpretation. The package was developed as an online interactive webpage within the university website. The program was freely accessible online via the Blackboard suite with the use of the student’s university username and password. On front page of the online package ,objectives of the activity were described. This included common understanding of the techniques used for obtaining a proper chest X-ray. Terms such as inspiration, penetration, and rotation were explained followed by examples of different images of those terms. Anatomy of the respiratory system was then described and demonstrated with figures of overlapping images of different elements of respiration with the actual chest X-ray. A common method of interpretation was then introduced to the students to develop a consistent and thorough technique for reading images and learn how the silhouette sign can help localize pathology. The final stage of the online package was demonstration of interactive images of different lung and respiratory system pathological lesions that could be recognised and identified by X-ray. Each image had a phase of plan image where no information was provided and then an image with full description and arrows showing the location, shape and forms of the pathology. From a long list of diseases presented pulmonary oedema, tuberculosis, fractured rib, diaphragmatic hernia and solitary pulmonary nodules were few of the popular examples. The X-ray e-learning package allowed pupils to explore the relevant anatomy and pathology that can be demonstrated with radiological imaging in a series of high-quality X-Ray images and associated teaching material.
X-ray interpretation skills were assessed at three time points in the study through an online multiple-choice questionnaire of thirty questions, with four possible answers and 2 min to complete each question. Questions were designed by an expert in radiology and checked with multiple qualified confederates.
At the conclusion of the study, participants were invited to complete a questionnaire assessing their satisfaction with the e-learning course using a 5-point Likert scale, in relation to the quality, accessibility, effectiveness and organisation of the online package, especially in comparison with didactic lecture-based learning. Students were also asked to complete free text responses to aspects of the e-learning course.
For the intervention group, the e-learning course was made available a week before the start of formal radiological teaching that included a lecture and one small-group workshop. Prior to being able to access the e-learning course, students were required to complete a pre-intervention questionnaire as detailed above. A week after the lecture and workshop classes, the intervention group was again administered a questionnaire (post-intervention assessment 1).
Participants in the control group completed the same questionnaire as the pre-intervention questionnaire of the intervention group. These participants had free access to the e-learning program after the completion of the study.
One year after the initial study, a follow up set of questionnaire was again administered to ensure that any meaningful variation in the marks collected from the control group were not affected by the time lapse of the delivered material in that cohort. Therefore, students in the intervention group were again invited to participate in another online multiple-choice questionnaire (post-intervention assessment 2).
All data was entered in to the statistical analysis software, Statistical Package for Social Sciences (SPSS version 22.0, IBM, New York, NY, USA). Final data was analysed using paired and independent t-tests and ANOVA (using LSD correction). Significance threshold was taken at p ≤ 0.05.
For the first year cohort, fifty-seven students out of one hundred and fifty-seven participated in the pre-intervention test, a response rate of 37.5 %. Forty-two students then participated in the post-intervention test 1, a response rate of 27.6 % and Forty-one students participated in the post-intervention test 2, a response rate of 26.9 %.
For the second year cohort, sixty-six students out of one hundred and forty-two participated in the test, a response rate of 44 %.
Scores from the MCQ tests for the control and intervention groups are presented in Table 1. The results indicate that students in the intervention group improved their X-ray interpretation skills from prior to the e-learning course (mean score of 57.9 %) to after implementation (mean score of 70 %), and this improvement was found to be statistically significant (p < 0.05).
Following e-learning, students in the intervention group scored higher in the MCQ test compared to participants in the control group who did not receive the e-learning course. Post-intervention scores for the intervention group (mean score of 70 %) was higher than the solitary MCQ for the control group (mean score of 63.2 %), and this difference was statistically significant (p < 0.05).
Furthermore, the follow up MCQ test after one year revealed that although there was a slight insignificant drop in the mean score of the second post-intervention assessment (mean score of 66.7 %), students in the intervention group maintained their X-ray interpretation skills and still achieved significantly higher marks that the control group (p < 0.05) (Fig. 1).
Tables 2 and 3 show the responses to the Likert scale statements from the first-year students (intervention group) and second year students (control group). Analysis of participants’ answers demonstrates that a majority of students (65.9 %) found the on-line course to be effective in guiding them through the learning process. An overwhelming proportion (86.4 %) of the students also found the X-ray online package to be well organised, and importantly, most of the students (71.4 %) indicated that the e-learning modality engaged them in learning.
Arguably of most relevance to this study, results of the student feedback show that a large majority of students (71.4 %) felt that the e-learning package was effective in helping them learn the art of interpreting X-rays. 71.4 % of students were also satisfied with the quality of the online learning activity.
Analysis of free text responses
Students were invited to comment on the most useful and engaging parts of the online learning package. In total, an average of thirty-two (32) students responded to the free text portion of the survey. There were three major themes that were raised by the students, where 31 % appreciated the resource, 15 % identified clinically relevant learning as the best aspect of the resource, and 12 % enjoyed the quantity of films available. Table 4 shows the key themes identified in the comments.
Basic radiology interpretation is a key skill for medical students . However, in most medical schools radiology training is not formally introduced until clinical rotations . Prior studies have demonstrated less than satisfactory interpretation skills in medical students, which may contribute to a high rate of incorrect statements found in clinical radiology report . Indeed, incompetence in x-ray interpretation has been shown to lead to management errors and adverse patient outcomes , which indicate that more effective training is needed in this vital area .
Acquisition of radiological skills can come from a number of sources . Due to its highly visual nature, radiology lends itself particularly well to online learning on multimedia devices. Advances in multimedia technologies have eased time pressures on educators and has paved the way for computer-assisted education . Evidence is also emerging that highlights the preference students have for computer-assisted learning when compared to reference books .
This study has demonstrated that learning radiology online is not only a more effective method, but also highly appreciated by students. Novice students improved significantly on x-ray interpretation scores following implementation of an e-learning x-ray interpretation course, scoring more highly on x-ray interpretation tests than students who did not receive e-learning. The students in the control group only experienced workshop and lecture teaching on x-ray interpretation, which the intervention group also received; and even though they were ahead in their studies by a year compared to the intervention group at the time of assessment, they performed worse than the group that received the online learning. This result is consistent with other evidence that has demonstrated implementation of online learning decreased the number of failing students , and that for radiography learning, students who experience computer-based learning score better in radiological assessment compared to ones who learn from a textbook [22, 23].
Three key themes emerged from the students’ free-text responses to the post-intervention survey: (1) students appreciated the online resource, (2) they found it clinically relevant, and (3) there was a sufficient quantity of X-rays to learn from. Other studies have also shown that students have a positive attitude towards on-line learning for radiology . This feedback from students is very important as it indicates the level to which students will access, and continue to access, this learning medium to enhance their skills in radiological interpretation. As most medical students have access to a personal computer, students are comfortable using computer-based information resources for their learning. A majority of students may even prefer online courses over using textbooks . Having an e-learning package available will allow pre-clinical students to hone their interpretation skills in a risk free environment at their own pace in preparation for clinical work .
With the progress of modern technology, there has been a significant increase in the use of simulation technology for teaching and assessment in medical education, which has provided additional opportunities for learning around the compact curriculum . E-learning modules have a number of advantages over the standard didactic approach that is familiar to most classrooms, such as the ability to learn at anytime and anywhere, without having to travel or take time off other commitments during business hours for live classes . Simulation via e-learning also allows students to hone their skills in a risk-free environment , and the learner is able to spend more time on certain subjects or skip others that they already know , allowing an increased autonomy in the educational experience for the student. However, it is important that the actual content of the e-learning is interactive and attempts to simulate real clinical scenarios. In a recent study by Tan and colleagues , the authors implemented an e-learning program that was an online recording of lectures and compared the performance of this group with that of one who experienced didactic teaching in the classroom. In this study, students scored similar results in e-learning versus lectures. This suggests that just because content is made available online, it doesn’t necessarily make it a better teaching tool than if it was available directly. It is important that the actual content of the e-learning is addressed, ensuring that students are challenged to think clinically by the program and apply their knowledge.
As more rural clinical schools are established in Australia and New Zealand, and the participation in courses by correspondence becomes anecdotally more popular with students, the electronic delivery of medical and health teaching will become a great priority . The results of this study demonstrate that implementing radiological education through electronic means improved knowledge and skills in X-ray interpretation for students who participated in the online learning tool. Year 1 students showed a statistically significant improvement in X-ray interpretation skills following implementation of an e-learning x-ray interpretation package. Assessment of the post-intervention Year 1 students also showed scores that were statistically significantly better than the scores of Year 2 students who did not receive the intervention. With the exception of access to the online e-learning tool, the Year 2 students teaching and learning experience was the same as that of the Year 1 students. Further research is required to determine if the improved skills in X-ray interpretation is sustained in those students who have benefitted from the e-learning tool.
Jeffrey DR, Goddard PR, Callaway MP, Greenwood R. Chest radiograph interpretation by medical students. Clin Radiol. 2003;58:478–81.
Benger JR, Lyburn ID. What is the effect of reporting all emergency department radiographs? Emerg Med J. 2003;20:40–3.
Dawes TJW, Vowler SL, Allen CMC, Dixon AK. Training improves medical student performance in image interpretation. Br J Radiol. 2004;77:775–6.
Eisen LA, Berger JS, Hegde A, Schneider RF. Competency in chest radiography. A comparison of medical students, residents, and fellows. J Gen Intern Med. 2006;21:460–5.
Feigin DS, Smirniotopoulos JG, Neher TJ. Retention of radiographic anatomy of the chest by 4th-year medical students. Acad Radiol. 2002;9:82–8.
Gatt ME, Spectre G, Paltiel O, Hiller N, Stalnikowicz R. Chest radiographs in the emergency department: is the radiologist really necessary? Postgrad Med J. 2003;79:214–7.
Grosvenor LJ, Verma R, O’Brien R, Entwisle JJ, Finlay D. Does reporting of plain chest radiographs affect the immediate management of patients admitted to a medical assessment unit? Clin Radiol. 2003;58:719–22.
Kuritzky L, Haddy RI, Curry RW. Interpretation of chest roentgenograms by primary care physicians. South Med J. 1987;80:1347–51.
Scheiner JD, Noto RB, McCarten KM. Importance of radiology clerkships in teaching medical students life-threatening abnormalities on conventional chest radiographs. Acad Radiol. 2002;9:217–20.
Subramaniam RM, Kim C, Scally P. Medical student radiology teaching in Australia and New Zealand. Australas Radiol. 2007;51:358–61.
Mirsadraee S, Mankad K, McCoubrie P, Roberts T, Kessel D. Radiology curriculum for undergraduate medical studies--a consensus survey. Clin Radiol. 2012;67:1155–61.
Branstetter BF, Faix LE, Humphrey AL, Schumann JB. Preclinical medical student training in radiology: the effect of early exposure. AJR Am J Roentgenol. 2007;188:9–14.
Scalese RJ, Obeso VT, Issenberg SB. Simulation technology for skills training and competency assessment in medical education. J Gen Intern Med. 2008;23 Suppl 1:46–9.
Pinto A, Brunese L, Pinto F, Acampora C, Romano L. E-learning and education in radiology. Eur J Radiol. 2011;78:368–71.
Sendra-Portero F, Torales-Chaparro OE, Ruiz-Gomez MJ. Medical students’ skills in image interpretation before and after training: a comparison between 3rd-year and 6th-year students from two different medical curricula. Eur J Radiol. 2012;81:3931–5.
Dikshit A, Wu D, Wu C, Zhao W. An online interactive simulation system for medical imaging education. Comput Med Imaging Graph. 2005;29:395–404.
Nyhsen CM, Steinberg LJ, O’Connell JE. Undergraduate radiology teaching from the student’s perspective. Insights Imaging. 2013;4:103–9.
Thurley P, Dennick R. Problem-based learning and radiology. Clin Radiol. 2008;63:623–8.
Carriero A, Bonomo L, Calliada F, Campioni P, Colosimo C, Cotroneo A, et al. E-learning in radiology: an Italian multicentre experience. Eur J Radiol. 2012;81:3936–41.
O’Brien KE, Cannarozzi ML, Torre DM, Mechaber AJ, Durning SJ. Training and assessment of CXR/basic radiology interpretation skills: results from the 2005 CDIM Survey. Teach Learn Med. 2008;20:157–62.
Peterson C. Factors associated with success or failure in radiological interpretation: diagnostic thinking approaches. Med Educ. 1999;33:251–9.
Maleck M, Fischer MR, Kammer B, Zeiler C, Mangel E, Schenk F, et al. Do computers teach better? A media comparison study for case-based teaching in radiology. Radiographics. 2001;21:1025–32.
Gutmark R, Halsted MJ, Perry L, Gold G. Use of computer databases to reduce radiograph reading errors. J Am Coll Radiol. 2007;4:65–8.
Meckfessel S, Stuhmer C, Bormann KH, Kupka T, Behrends M, Matthies H, et al. Introduction of e-learning in dental radiology reveals significantly improved results in final examination. J Craniomaxillofac Surg. 2011;39:40–8.
Vuchkova J, Maybury T, Farah CS. Digital interactive learning of oral radiographic anatomy. Eur J Dent Educ. 2012;16:e79–87.
Tan P-L, Hay DB, Whaites E. Implementing e-learning in a radiological science course in dental education: a short-term longitudinal study. J Dent Educ. 2009;73:1202–12.
Subramaniam RM, Gibson RN. Radiology teaching: essentials of a quality teaching programme. Australas Radiol. 2007;51:42–5.
Authors would like to acknowledge Professor Gary Rogers for his constructive review and fruitful comments on this paper. Authors would also like to thank two special staff at Griffith University School of Medicine, Mr. Kelvin Upton for preparation of workshops and the clinical skills facility and Mr. Jacob Sharples for brilliant online design and constant support.
The authors declare that they have no competing interests.
AS conceived the idea for the paper from the workshop series that he is running regularly in the school of medicine. He designed the study, was involved in ethics application, data collection, analysis and write up of the paper in addition to running the workshops. AJ and SP provided the resources for the online package, the MCQs, marking criteria and draft collection. ED-E has been involved with the ethics application, advertisement of the research work in the school and data collection. All authors read and approved the final manuscript.
Dr. Ali Salajegheh is a medical practitioner and medical educator. He is senior lecturer in medical education and the stream lead of physical examination skills at Griffith University, School of Medicine. He has been involved in medical research throughout his career with major interest in medical education in addition to cancer molecular biology.
Dr. Alborz Jahangiri is a medical practitioner, University lecturer, and a radiology registrar. He has been involved in many different research project in the field of radiology and medical education.
Dr. Elliot Dolan-Evans is a recent medical graduate who has an interest in student advocacy and improving medical education through his roles in various student societies. He currently has strong research interests in cancer, neuroscience and medical education. In recognition of his work in this area, Elliot has received many awards for his leadership potential.
Dr. Sahar Pakneshan is a medical practitioner, lecturer and associate academic manager Years 3 and 4 at Griffith University, School of Medicine. She has been involved in many different research project in the school of medicine in the field of medical education.